2023-02-13 00:03:20,570 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-13 00:03:20,615 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=168, AvailableMemoryMB=5217 2023-02-13 00:03:20,900 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4 2023-02-13 00:03:20,910 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:03:20,911 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a, deleteOnExit=true 2023-02-13 00:03:20,911 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:03:20,912 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/test.cache.data in system properties and HBase conf 2023-02-13 00:03:20,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:03:20,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:03:20,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:03:20,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:03:20,914 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:03:21,018 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 00:03:21,380 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:03:21,385 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:21,386 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:21,386 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:03:21,387 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:21,387 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:03:21,387 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:03:21,388 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:21,388 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:21,389 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:03:21,389 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:03:21,390 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:03:21,390 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:21,390 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:03:21,391 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:03:21,918 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:21,922 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:22,182 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 00:03:22,344 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 00:03:22,356 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:22,390 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:22,421 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/java.io.tmpdir/Jetty_localhost_44457_hdfs____.75e6f4/webapp 2023-02-13 00:03:22,570 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44457 2023-02-13 00:03:22,585 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:22,585 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:23,098 WARN [Listener at localhost/42801] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:23,178 WARN [Listener at localhost/42801] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:23,200 WARN [Listener at localhost/42801] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:23,206 INFO [Listener at localhost/42801] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:23,212 INFO [Listener at localhost/42801] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/java.io.tmpdir/Jetty_localhost_37439_datanode____xns3a5/webapp 2023-02-13 00:03:23,338 INFO [Listener at localhost/42801] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37439 2023-02-13 00:03:23,838 WARN [Listener at localhost/37363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:23,885 WARN [Listener at localhost/37363] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:23,888 WARN [Listener at localhost/37363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:23,890 INFO [Listener at localhost/37363] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:23,897 INFO [Listener at localhost/37363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/java.io.tmpdir/Jetty_localhost_44557_datanode____s97blq/webapp 2023-02-13 00:03:24,024 INFO [Listener at localhost/37363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44557 2023-02-13 00:03:24,044 WARN [Listener at localhost/40573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:24,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3002ed553f5fbf1: Processing first storage report for DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78 from datanode dc29ff12-4c3d-4d52-b204-640b9404ebd7 2023-02-13 00:03:24,373 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3002ed553f5fbf1: from storage DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78 node DatanodeRegistration(127.0.0.1:39749, datanodeUuid=dc29ff12-4c3d-4d52-b204-640b9404ebd7, infoPort=38119, infoSecurePort=0, ipcPort=40573, storageInfo=lv=-57;cid=testClusterID;nsid=12751509;c=1676246601990), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 00:03:24,374 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bbe06324c3c02e2: Processing first storage report for DS-aa884606-ba49-4185-8200-8dfa08ee9cb3 from datanode 0ba714d2-aaec-4d5b-a12b-75321a20e182 2023-02-13 00:03:24,374 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bbe06324c3c02e2: from storage DS-aa884606-ba49-4185-8200-8dfa08ee9cb3 node DatanodeRegistration(127.0.0.1:43217, datanodeUuid=0ba714d2-aaec-4d5b-a12b-75321a20e182, infoPort=35481, infoSecurePort=0, ipcPort=37363, storageInfo=lv=-57;cid=testClusterID;nsid=12751509;c=1676246601990), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:24,374 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3002ed553f5fbf1: Processing first storage report for DS-80164e0a-923f-4a61-a83f-4e92223563b2 from datanode dc29ff12-4c3d-4d52-b204-640b9404ebd7 2023-02-13 00:03:24,374 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3002ed553f5fbf1: from storage DS-80164e0a-923f-4a61-a83f-4e92223563b2 node DatanodeRegistration(127.0.0.1:39749, datanodeUuid=dc29ff12-4c3d-4d52-b204-640b9404ebd7, infoPort=38119, infoSecurePort=0, ipcPort=40573, storageInfo=lv=-57;cid=testClusterID;nsid=12751509;c=1676246601990), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:24,374 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bbe06324c3c02e2: Processing first storage report for DS-4df1b42a-c26b-4a59-86ee-243a5addc552 from datanode 0ba714d2-aaec-4d5b-a12b-75321a20e182 2023-02-13 00:03:24,374 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bbe06324c3c02e2: from storage DS-4df1b42a-c26b-4a59-86ee-243a5addc552 node DatanodeRegistration(127.0.0.1:43217, datanodeUuid=0ba714d2-aaec-4d5b-a12b-75321a20e182, infoPort=35481, infoSecurePort=0, ipcPort=37363, storageInfo=lv=-57;cid=testClusterID;nsid=12751509;c=1676246601990), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:24,488 DEBUG [Listener at localhost/40573] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4 2023-02-13 00:03:24,579 INFO [Listener at localhost/40573] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/zookeeper_0, clientPort=53518, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:03:24,597 INFO [Listener at localhost/40573] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53518 2023-02-13 00:03:24,607 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:24,610 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:25,270 INFO [Listener at localhost/40573] util.FSUtils(479): Created version file at hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d with version=8 2023-02-13 00:03:25,271 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:25,273 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:25,276 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/hbase-staging 2023-02-13 00:03:25,619 INFO [Listener at localhost/40573] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 00:03:26,119 INFO [Listener at localhost/40573] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:26,152 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,153 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,154 INFO [Listener at localhost/40573] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:26,154 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,154 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:26,303 INFO [Listener at localhost/40573] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:26,376 DEBUG [Listener at localhost/40573] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 00:03:26,469 INFO [Listener at localhost/40573] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43853 2023-02-13 00:03:26,480 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,482 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,504 INFO [Listener at localhost/40573] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43853 connecting to ZooKeeper ensemble=127.0.0.1:53518 2023-02-13 00:03:26,548 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:438530x0, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:26,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43853-0x1004afd44d30000 connected 2023-02-13 00:03:26,578 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:26,579 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:26,582 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:26,590 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43853 2023-02-13 00:03:26,591 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43853 2023-02-13 00:03:26,591 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43853 2023-02-13 00:03:26,593 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43853 2023-02-13 00:03:26,593 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43853 2023-02-13 00:03:26,599 INFO [Listener at localhost/40573] master.HMaster(439): hbase.rootdir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d, hbase.cluster.distributed=false 2023-02-13 00:03:26,669 INFO [Listener at localhost/40573] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:26,669 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,669 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,669 INFO [Listener at localhost/40573] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:26,670 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,670 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:26,674 INFO [Listener at localhost/40573] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:26,677 INFO [Listener at localhost/40573] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38931 2023-02-13 00:03:26,680 INFO [Listener at localhost/40573] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:26,687 DEBUG [Listener at localhost/40573] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:26,688 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,689 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,691 INFO [Listener at localhost/40573] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38931 connecting to ZooKeeper ensemble=127.0.0.1:53518 2023-02-13 00:03:26,696 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:389310x0, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:26,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38931-0x1004afd44d30001 connected 2023-02-13 00:03:26,698 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:26,699 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:26,700 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:26,700 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38931 2023-02-13 00:03:26,701 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38931 2023-02-13 00:03:26,701 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38931 2023-02-13 00:03:26,702 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38931 2023-02-13 00:03:26,702 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38931 2023-02-13 00:03:26,714 INFO [Listener at localhost/40573] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:26,714 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,715 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,715 INFO [Listener at localhost/40573] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:26,715 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:26,715 INFO [Listener at localhost/40573] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:26,716 INFO [Listener at localhost/40573] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:26,721 INFO [Listener at localhost/40573] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42817 2023-02-13 00:03:26,721 INFO [Listener at localhost/40573] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:26,722 DEBUG [Listener at localhost/40573] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:26,723 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,725 INFO [Listener at localhost/40573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,728 INFO [Listener at localhost/40573] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42817 connecting to ZooKeeper ensemble=127.0.0.1:53518 2023-02-13 00:03:26,732 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:428170x0, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:26,733 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): regionserver:428170x0, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:26,734 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): regionserver:428170x0, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:26,735 DEBUG [Listener at localhost/40573] zookeeper.ZKUtil(164): regionserver:428170x0, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:26,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42817-0x1004afd44d30002 connected 2023-02-13 00:03:26,736 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42817 2023-02-13 00:03:26,737 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42817 2023-02-13 00:03:26,738 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42817 2023-02-13 00:03:26,738 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42817 2023-02-13 00:03:26,738 DEBUG [Listener at localhost/40573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42817 2023-02-13 00:03:26,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:26,750 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:26,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:26,769 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:26,769 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:26,769 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:26,769 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:26,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:26,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43853,1676246605448 from backup master directory 2023-02-13 00:03:26,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:26,776 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:26,776 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:26,777 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:26,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:26,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 00:03:26,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 00:03:26,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/hbase.id with ID: 9874b20c-0c2c-4478-848b-b72ec1350311 2023-02-13 00:03:26,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:26,930 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:26,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1848ebed to 127.0.0.1:53518 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:27,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ec3e9dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:27,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:27,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:03:27,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 00:03:27,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 00:03:27,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 00:03:27,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 00:03:27,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:27,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store-tmp 2023-02-13 00:03:27,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:27,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:27,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:27,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:27,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:27,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:27,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:27,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246607141Disabling compacts and flushes for region at 1676246607141Disabling writes for close at 1676246607142 (+1 ms)Writing region close event to WAL at 1676246607142Closed at 1676246607142 2023-02-13 00:03:27,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/WALs/jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:27,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43853%2C1676246605448, suffix=, logDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/WALs/jenkins-hbase4.apache.org,43853,1676246605448, archiveDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/oldWALs, maxLogs=10 2023-02-13 00:03:27,219 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK] 2023-02-13 00:03:27,219 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK] 2023-02-13 00:03:27,228 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 00:03:27,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/WALs/jenkins-hbase4.apache.org,43853,1676246605448/jenkins-hbase4.apache.org%2C43853%2C1676246605448.1676246607176 2023-02-13 00:03:27,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK], DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK]] 2023-02-13 00:03:27,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:27,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:27,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:27,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:27,359 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:27,366 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:03:27,394 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:03:27,406 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:27,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:27,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:27,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:27,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:27,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69401748, jitterRate=0.03416663408279419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:27,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246607328Initializing all the Stores at 1676246607330 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246607331 (+1 ms)Cleaning up temporary data from old regions at 1676246607420 (+89 ms)Cleaning up detritus from prior splits at 1676246607421 (+1 ms)Region opened successfully at 1676246607436 (+15 ms) 2023-02-13 00:03:27,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:03:27,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:03:27,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:03:27,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:03:27,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 00:03:27,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-13 00:03:27,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:03:27,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:03:27,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:03:27,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:03:27,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:03:27,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:03:27,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:03:27,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:03:27,578 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:27,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:03:27,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:03:27,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:03:27,598 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:27,598 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:27,598 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:27,598 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:27,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43853,1676246605448, sessionid=0x1004afd44d30000, setting cluster-up flag (Was=false) 2023-02-13 00:03:27,616 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:27,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:03:27,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:27,629 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:27,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:03:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:27,640 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.hbase-snapshot/.tmp 2023-02-13 00:03:27,743 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(952): ClusterId : 9874b20c-0c2c-4478-848b-b72ec1350311 2023-02-13 00:03:27,743 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(952): ClusterId : 9874b20c-0c2c-4478-848b-b72ec1350311 2023-02-13 00:03:27,750 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:27,750 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:27,757 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:27,757 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:27,757 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:27,757 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:27,761 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:27,761 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:27,763 DEBUG [RS:0;jenkins-hbase4:38931] zookeeper.ReadOnlyZKClient(139): Connect 0x7ef028a8 to 127.0.0.1:53518 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:27,763 DEBUG [RS:1;jenkins-hbase4:42817] zookeeper.ReadOnlyZKClient(139): Connect 0x160b7df9 to 127.0.0.1:53518 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:27,769 DEBUG [RS:1;jenkins-hbase4:42817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1da725d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:27,770 DEBUG [RS:0;jenkins-hbase4:38931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42e16a42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:27,770 DEBUG [RS:1;jenkins-hbase4:42817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ae66868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:27,770 DEBUG [RS:0;jenkins-hbase4:38931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dbcaa63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:27,797 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38931 2023-02-13 00:03:27,797 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42817 2023-02-13 00:03:27,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:27,803 INFO [RS:0;jenkins-hbase4:38931] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:27,803 INFO [RS:1;jenkins-hbase4:42817] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:27,804 INFO [RS:0;jenkins-hbase4:38931] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:27,804 INFO [RS:1;jenkins-hbase4:42817] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:27,804 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:27,804 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:27,806 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43853,1676246605448 with isa=jenkins-hbase4.apache.org/172.31.14.131:38931, startcode=1676246606668 2023-02-13 00:03:27,806 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43853,1676246605448 with isa=jenkins-hbase4.apache.org/172.31.14.131:42817, startcode=1676246606714 2023-02-13 00:03:27,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:27,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:27,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:27,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:27,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:03:27,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:27,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:27,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:27,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246637821 2023-02-13 00:03:27,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:03:27,825 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:27,826 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:03:27,828 DEBUG [RS:1;jenkins-hbase4:42817] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:27,828 DEBUG [RS:0;jenkins-hbase4:38931] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:27,832 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:27,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:03:27,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:03:27,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:03:27,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:03:27,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:03:27,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:03:27,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:03:27,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:03:27,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:03:27,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:03:27,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246607864,5,FailOnTimeoutGroup] 2023-02-13 00:03:27,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246607868,5,FailOnTimeoutGroup] 2023-02-13 00:03:27,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:27,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:03:27,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:27,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:27,889 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:27,891 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:27,891 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d 2023-02-13 00:03:27,897 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49693, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:27,897 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55947, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:27,931 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:27,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43853] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:27,935 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:27,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:27,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/info 2023-02-13 00:03:27,943 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:27,945 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:27,947 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:27,949 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:27,950 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:27,951 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:27,951 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:27,953 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d 2023-02-13 00:03:27,953 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d 2023-02-13 00:03:27,953 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42801 2023-02-13 00:03:27,953 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42801 2023-02-13 00:03:27,953 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:27,953 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:27,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/table 2023-02-13 00:03:27,956 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:27,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:27,959 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740 2023-02-13 00:03:27,959 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740 2023-02-13 00:03:27,960 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:27,964 DEBUG [RS:0;jenkins-hbase4:38931] zookeeper.ZKUtil(162): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:27,965 WARN [RS:0;jenkins-hbase4:38931] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:27,965 DEBUG [RS:1;jenkins-hbase4:42817] zookeeper.ZKUtil(162): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:27,965 INFO [RS:0;jenkins-hbase4:38931] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:27,964 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:27,965 WARN [RS:1;jenkins-hbase4:42817] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:27,965 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:27,965 INFO [RS:1;jenkins-hbase4:42817] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:27,966 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:27,969 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:27,969 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42817,1676246606714] 2023-02-13 00:03:27,970 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38931,1676246606668] 2023-02-13 00:03:27,978 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:27,979 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63831338, jitterRate=-0.04883894324302673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:27,979 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246607935Initializing all the Stores at 1676246607937 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246607937Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246607937Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246607937Cleaning up temporary data from old regions at 1676246607962 (+25 ms)Cleaning up detritus from prior splits at 1676246607963 (+1 ms)Region opened successfully at 1676246607979 (+16 ms) 2023-02-13 00:03:27,979 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:27,979 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:27,979 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:27,979 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:27,980 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:27,981 DEBUG [RS:0;jenkins-hbase4:38931] zookeeper.ZKUtil(162): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:27,981 DEBUG [RS:1;jenkins-hbase4:42817] zookeeper.ZKUtil(162): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:27,984 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:27,984 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246607979Disabling compacts and flushes for region at 1676246607979Disabling writes for close at 1676246607980 (+1 ms)Writing region close event to WAL at 1676246607983 (+3 ms)Closed at 1676246607983 2023-02-13 00:03:27,984 DEBUG [RS:0;jenkins-hbase4:38931] zookeeper.ZKUtil(162): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:27,984 DEBUG [RS:1;jenkins-hbase4:42817] zookeeper.ZKUtil(162): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:27,990 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:27,990 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:03:27,997 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:27,997 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:28,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:03:28,008 INFO [RS:0;jenkins-hbase4:38931] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:28,008 INFO [RS:1;jenkins-hbase4:42817] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:28,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:03:28,018 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:03:28,034 INFO [RS:1;jenkins-hbase4:42817] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:28,034 INFO [RS:0;jenkins-hbase4:38931] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:28,039 INFO [RS:1;jenkins-hbase4:42817] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:28,039 INFO [RS:0;jenkins-hbase4:38931] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:28,040 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,040 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,041 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:28,044 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:28,053 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,053 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,053 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,053 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,054 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:28,054 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:28,054 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:0;jenkins-hbase4:38931] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,055 DEBUG [RS:1;jenkins-hbase4:42817] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:28,062 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,062 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,062 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,063 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,063 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,063 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,084 INFO [RS:1;jenkins-hbase4:42817] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:28,084 INFO [RS:0;jenkins-hbase4:38931] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:28,088 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42817,1676246606714-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,088 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38931,1676246606668-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,108 INFO [RS:0;jenkins-hbase4:38931] regionserver.Replication(203): jenkins-hbase4.apache.org,38931,1676246606668 started 2023-02-13 00:03:28,108 INFO [RS:1;jenkins-hbase4:42817] regionserver.Replication(203): jenkins-hbase4.apache.org,42817,1676246606714 started 2023-02-13 00:03:28,108 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38931,1676246606668, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38931, sessionid=0x1004afd44d30001 2023-02-13 00:03:28,108 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42817,1676246606714, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42817, sessionid=0x1004afd44d30002 2023-02-13 00:03:28,108 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:28,108 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:28,108 DEBUG [RS:0;jenkins-hbase4:38931] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:28,108 DEBUG [RS:1;jenkins-hbase4:42817] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:28,109 DEBUG [RS:0;jenkins-hbase4:38931] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38931,1676246606668' 2023-02-13 00:03:28,109 DEBUG [RS:1;jenkins-hbase4:42817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42817,1676246606714' 2023-02-13 00:03:28,110 DEBUG [RS:1;jenkins-hbase4:42817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:28,109 DEBUG [RS:0;jenkins-hbase4:38931] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:28,110 DEBUG [RS:1;jenkins-hbase4:42817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:28,110 DEBUG [RS:0;jenkins-hbase4:38931] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:28,111 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:28,111 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:28,111 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:28,111 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:28,111 DEBUG [RS:1;jenkins-hbase4:42817] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:28,111 DEBUG [RS:0;jenkins-hbase4:38931] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:28,112 DEBUG [RS:0;jenkins-hbase4:38931] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38931,1676246606668' 2023-02-13 00:03:28,112 DEBUG [RS:0;jenkins-hbase4:38931] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:28,112 DEBUG [RS:1;jenkins-hbase4:42817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42817,1676246606714' 2023-02-13 00:03:28,112 DEBUG [RS:1;jenkins-hbase4:42817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:28,112 DEBUG [RS:0;jenkins-hbase4:38931] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:28,112 DEBUG [RS:1;jenkins-hbase4:42817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:28,113 DEBUG [RS:0;jenkins-hbase4:38931] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:28,113 DEBUG [RS:1;jenkins-hbase4:42817] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:28,113 INFO [RS:0;jenkins-hbase4:38931] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:28,113 INFO [RS:1;jenkins-hbase4:42817] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:28,113 INFO [RS:0;jenkins-hbase4:38931] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:28,113 INFO [RS:1;jenkins-hbase4:42817] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:28,170 DEBUG [jenkins-hbase4:43853] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:03:28,174 DEBUG [jenkins-hbase4:43853] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:28,180 DEBUG [jenkins-hbase4:43853] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:28,180 DEBUG [jenkins-hbase4:43853] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:28,180 DEBUG [jenkins-hbase4:43853] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:28,184 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42817,1676246606714, state=OPENING 2023-02-13 00:03:28,193 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:03:28,196 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:28,197 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:28,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:28,388 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:28,390 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:28,393 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42394, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:28,405 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:03:28,406 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:28,409 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42817%2C1676246606714.meta, suffix=.meta, logDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,42817,1676246606714, archiveDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/oldWALs, maxLogs=32 2023-02-13 00:03:28,428 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK] 2023-02-13 00:03:28,428 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK] 2023-02-13 00:03:28,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,42817,1676246606714/jenkins-hbase4.apache.org%2C42817%2C1676246606714.meta.1676246608412.meta 2023-02-13 00:03:28,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK], DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK]] 2023-02-13 00:03:28,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:28,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:03:28,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:03:28,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:03:28,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:03:28,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:28,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:03:28,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:03:28,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:28,470 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/info 2023-02-13 00:03:28,470 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/info 2023-02-13 00:03:28,471 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:28,473 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:28,473 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:28,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:28,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:28,475 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:28,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:28,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:28,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/table 2023-02-13 00:03:28,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/table 2023-02-13 00:03:28,479 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:28,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:28,482 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740 2023-02-13 00:03:28,485 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740 2023-02-13 00:03:28,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:28,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:28,504 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74146409, jitterRate=0.1048675924539566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:28,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246608465Writing region info on filesystem at 1676246608466 (+1 ms)Initializing all the Stores at 1676246608468 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246608468Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246608468Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246608468Cleaning up temporary data from old regions at 1676246608488 (+20 ms)Cleaning up detritus from prior splits at 1676246608488Running coprocessor post-open hooks at 1676246608504 (+16 ms)Region opened successfully at 1676246608504 2023-02-13 00:03:28,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246608380 2023-02-13 00:03:28,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:03:28,536 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:03:28,536 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42817,1676246606714, state=OPEN 2023-02-13 00:03:28,539 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:03:28,540 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:28,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:03:28,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42817,1676246606714 in 339 msec 2023-02-13 00:03:28,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:03:28,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 544 msec 2023-02-13 00:03:28,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 831 msec 2023-02-13 00:03:28,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246606765, completionTime=-1 2023-02-13 00:03:28,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:03:28,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:03:28,627 DEBUG [hconnection-0x51963a91-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:28,630 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:28,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:03:28,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246668646 2023-02-13 00:03:28,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246728646 2023-02-13 00:03:28,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 90 msec 2023-02-13 00:03:28,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43853,1676246605448-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43853,1676246605448-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43853,1676246605448-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43853, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:28,679 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:03:28,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:03:28,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:28,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:03:28,700 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:28,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:28,725 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:28,727 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb empty. 2023-02-13 00:03:28,728 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:28,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:03:28,757 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:28,759 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 51fe59f9eaa311304d170570896f0eeb, NAME => 'hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:28,775 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:28,775 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 51fe59f9eaa311304d170570896f0eeb, disabling compactions & flushes 2023-02-13 00:03:28,775 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:28,775 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:28,775 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. after waiting 0 ms 2023-02-13 00:03:28,775 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:28,775 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:28,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 51fe59f9eaa311304d170570896f0eeb: Waiting for close lock at 1676246608775Disabling compacts and flushes for region at 1676246608775Disabling writes for close at 1676246608775Writing region close event to WAL at 1676246608775Closed at 1676246608775 2023-02-13 00:03:28,780 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:28,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246608783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246608783"}]},"ts":"1676246608783"} 2023-02-13 00:03:28,820 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:03:28,822 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:28,826 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246608822"}]},"ts":"1676246608822"} 2023-02-13 00:03:28,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:03:28,835 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:28,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:28,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:28,838 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:28,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=51fe59f9eaa311304d170570896f0eeb, ASSIGN}] 2023-02-13 00:03:28,845 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=51fe59f9eaa311304d170570896f0eeb, ASSIGN 2023-02-13 00:03:28,847 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=51fe59f9eaa311304d170570896f0eeb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38931,1676246606668; forceNewPlan=false, retain=false 2023-02-13 00:03:28,999 INFO [jenkins-hbase4:43853] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:03:29,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=51fe59f9eaa311304d170570896f0eeb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:29,001 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246609000"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246609000"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246609000"}]},"ts":"1676246609000"} 2023-02-13 00:03:29,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 51fe59f9eaa311304d170570896f0eeb, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:29,125 INFO [RS:0;jenkins-hbase4:38931] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38931%2C1676246606668, suffix=, logDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,38931,1676246606668, archiveDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/oldWALs, maxLogs=32 2023-02-13 00:03:29,125 INFO [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42817%2C1676246606714, suffix=, logDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,42817,1676246606714, archiveDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/oldWALs, maxLogs=32 2023-02-13 00:03:29,147 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK] 2023-02-13 00:03:29,147 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK] 2023-02-13 00:03:29,159 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK] 2023-02-13 00:03:29,159 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK] 2023-02-13 00:03:29,161 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:29,161 INFO [RS:0;jenkins-hbase4:38931] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,38931,1676246606668/jenkins-hbase4.apache.org%2C38931%2C1676246606668.1676246609126 2023-02-13 00:03:29,161 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:29,161 DEBUG [RS:0;jenkins-hbase4:38931] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK], DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK]] 2023-02-13 00:03:29,170 INFO [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/WALs/jenkins-hbase4.apache.org,42817,1676246606714/jenkins-hbase4.apache.org%2C42817%2C1676246606714.1676246609127 2023-02-13 00:03:29,171 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:29,171 DEBUG [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43217,DS-aa884606-ba49-4185-8200-8dfa08ee9cb3,DISK], DatanodeInfoWithStorage[127.0.0.1:39749,DS-3f34d34d-59f1-40b6-8647-bf16f9f5ee78,DISK]] 2023-02-13 00:03:29,177 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:29,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 51fe59f9eaa311304d170570896f0eeb, NAME => 'hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:29,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,185 INFO [StoreOpener-51fe59f9eaa311304d170570896f0eeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,188 DEBUG [StoreOpener-51fe59f9eaa311304d170570896f0eeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/info 2023-02-13 00:03:29,188 DEBUG [StoreOpener-51fe59f9eaa311304d170570896f0eeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/info 2023-02-13 00:03:29,189 INFO [StoreOpener-51fe59f9eaa311304d170570896f0eeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 51fe59f9eaa311304d170570896f0eeb columnFamilyName info 2023-02-13 00:03:29,189 INFO [StoreOpener-51fe59f9eaa311304d170570896f0eeb-1] regionserver.HStore(310): Store=51fe59f9eaa311304d170570896f0eeb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:29,191 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,192 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,196 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:29,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:29,201 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 51fe59f9eaa311304d170570896f0eeb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67773241, jitterRate=0.009899988770484924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:29,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 51fe59f9eaa311304d170570896f0eeb: Running coprocessor pre-open hook at 1676246609180Writing region info on filesystem at 1676246609180Initializing all the Stores at 1676246609182 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246609182Cleaning up temporary data from old regions at 1676246609193 (+11 ms)Cleaning up detritus from prior splits at 1676246609193Running coprocessor post-open hooks at 1676246609201 (+8 ms)Region opened successfully at 1676246609201 2023-02-13 00:03:29,203 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb., pid=6, masterSystemTime=1676246609160 2023-02-13 00:03:29,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:29,207 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:29,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=51fe59f9eaa311304d170570896f0eeb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:29,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246609208"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246609208"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246609208"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246609208"}]},"ts":"1676246609208"} 2023-02-13 00:03:29,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:03:29,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 51fe59f9eaa311304d170570896f0eeb, server=jenkins-hbase4.apache.org,38931,1676246606668 in 207 msec 2023-02-13 00:03:29,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:03:29,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=51fe59f9eaa311304d170570896f0eeb, ASSIGN in 376 msec 2023-02-13 00:03:29,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:29,223 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246609223"}]},"ts":"1676246609223"} 2023-02-13 00:03:29,227 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:03:29,230 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:29,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 541 msec 2023-02-13 00:03:29,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:03:29,303 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:29,303 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:29,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:29,328 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59896, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:29,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:03:29,366 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:29,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-02-13 00:03:29,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:03:29,391 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:29,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-13 00:03:29,405 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:03:29,408 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:03:29,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.631sec 2023-02-13 00:03:29,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:03:29,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:03:29,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:03:29,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43853,1676246605448-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:03:29,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43853,1676246605448-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:03:29,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:03:29,450 DEBUG [Listener at localhost/40573] zookeeper.ReadOnlyZKClient(139): Connect 0x78a8a201 to 127.0.0.1:53518 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:29,456 DEBUG [Listener at localhost/40573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ac00ad9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:29,498 DEBUG [hconnection-0x6b5959b0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:29,510 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42422, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:29,520 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:29,520 DEBUG [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:03:29,529 DEBUG [Listener at localhost/40573] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:03:29,531 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:03:29,536 INFO [Listener at localhost/40573] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 00:03:29,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 00:03:29,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:03:29,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:32876 deadline: 1676246669539, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 00:03:29,557 INFO [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 00:03:29,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:29,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 00:03:29,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:29,577 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:29,580 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 00:03:29,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:29,600 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:29,601 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:29,601 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:29,601 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:29,602 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 empty. 2023-02-13 00:03:29,603 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 empty. 2023-02-13 00:03:29,603 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 2023-02-13 00:03:29,603 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:29,604 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 empty. 2023-02-13 00:03:29,604 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d empty. 2023-02-13 00:03:29,606 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:29,606 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:29,606 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 empty. 2023-02-13 00:03:29,607 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed empty. 2023-02-13 00:03:29,607 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:29,607 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 2023-02-13 00:03:29,607 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b empty. 2023-02-13 00:03:29,607 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 empty. 2023-02-13 00:03:29,608 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 empty. 2023-02-13 00:03:29,609 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec empty. 2023-02-13 00:03:29,610 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 2023-02-13 00:03:29,610 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:29,610 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 2023-02-13 00:03:29,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 00:03:29,632 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:29,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e2c1534c85d18491550a0e42706666ed, NAME => 'testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fbc423bd225efe8d3c0c264305faab3, NAME => 'testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 80cbbd1557f99d8399d9bef4febabb4d, NAME => 'testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,698 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,699 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5fbc423bd225efe8d3c0c264305faab3, disabling compactions & flushes 2023-02-13 00:03:29,699 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:29,699 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:29,699 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. after waiting 0 ms 2023-02-13 00:03:29,699 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:29,699 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,699 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:29,702 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 80cbbd1557f99d8399d9bef4febabb4d, disabling compactions & flushes 2023-02-13 00:03:29,702 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5fbc423bd225efe8d3c0c264305faab3: Waiting for close lock at 1676246609699Disabling compacts and flushes for region at 1676246609699Disabling writes for close at 1676246609699Writing region close event to WAL at 1676246609699Closed at 1676246609699 2023-02-13 00:03:29,702 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:29,703 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:29,703 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. after waiting 0 ms 2023-02-13 00:03:29,703 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 34e9215f152c749d1b2855bf5988c248, NAME => 'testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:29,703 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:29,704 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:29,704 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,705 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 80cbbd1557f99d8399d9bef4febabb4d: Waiting for close lock at 1676246609702Disabling compacts and flushes for region at 1676246609702Disabling writes for close at 1676246609703 (+1 ms)Writing region close event to WAL at 1676246609704 (+1 ms)Closed at 1676246609704 2023-02-13 00:03:29,705 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e2c1534c85d18491550a0e42706666ed, disabling compactions & flushes 2023-02-13 00:03:29,705 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:29,705 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e2f1890c8e2d83f800fa4dfa489f5d90, NAME => 'testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,705 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:29,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. after waiting 0 ms 2023-02-13 00:03:29,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:29,706 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:29,706 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e2c1534c85d18491550a0e42706666ed: Waiting for close lock at 1676246609705Disabling compacts and flushes for region at 1676246609705Disabling writes for close at 1676246609706 (+1 ms)Writing region close event to WAL at 1676246609706Closed at 1676246609706 2023-02-13 00:03:29,707 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a5008e8e7077dcb7a211705461185553, NAME => 'testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 34e9215f152c749d1b2855bf5988c248, disabling compactions & flushes 2023-02-13 00:03:29,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:29,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:29,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. after waiting 0 ms 2023-02-13 00:03:29,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:29,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:29,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 34e9215f152c749d1b2855bf5988c248: Waiting for close lock at 1676246609731Disabling compacts and flushes for region at 1676246609731Disabling writes for close at 1676246609731Writing region close event to WAL at 1676246609731Closed at 1676246609731 2023-02-13 00:03:29,733 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0e7c1f9de8c918de0f291881e0de540b, NAME => 'testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a5008e8e7077dcb7a211705461185553, disabling compactions & flushes 2023-02-13 00:03:29,733 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:29,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:29,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. after waiting 0 ms 2023-02-13 00:03:29,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:29,734 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:29,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a5008e8e7077dcb7a211705461185553: Waiting for close lock at 1676246609733Disabling compacts and flushes for region at 1676246609733Disabling writes for close at 1676246609734 (+1 ms)Writing region close event to WAL at 1676246609734Closed at 1676246609734 2023-02-13 00:03:29,734 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a8d913dcb78336766996717a08757b81, NAME => 'testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e2f1890c8e2d83f800fa4dfa489f5d90, disabling compactions & flushes 2023-02-13 00:03:29,735 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:29,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:29,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. after waiting 0 ms 2023-02-13 00:03:29,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:29,735 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:29,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e2f1890c8e2d83f800fa4dfa489f5d90: Waiting for close lock at 1676246609735Disabling compacts and flushes for region at 1676246609735Disabling writes for close at 1676246609735Writing region close event to WAL at 1676246609735Closed at 1676246609735 2023-02-13 00:03:29,736 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ced57dbebf889853620545c25b19a141, NAME => 'testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,763 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,764 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0e7c1f9de8c918de0f291881e0de540b, disabling compactions & flushes 2023-02-13 00:03:29,764 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:29,764 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:29,764 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. after waiting 0 ms 2023-02-13 00:03:29,764 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:29,764 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:29,764 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,764 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0e7c1f9de8c918de0f291881e0de540b: Waiting for close lock at 1676246609764Disabling compacts and flushes for region at 1676246609764Disabling writes for close at 1676246609764Writing region close event to WAL at 1676246609764Closed at 1676246609764 2023-02-13 00:03:29,765 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a8d913dcb78336766996717a08757b81, disabling compactions & flushes 2023-02-13 00:03:29,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. after waiting 0 ms 2023-02-13 00:03:29,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fd8d083355a03b05437fe4a6ddb21ec, NAME => 'testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ced57dbebf889853620545c25b19a141, disabling compactions & flushes 2023-02-13 00:03:29,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:29,766 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a8d913dcb78336766996717a08757b81: Waiting for close lock at 1676246609765Disabling compacts and flushes for region at 1676246609765Disabling writes for close at 1676246609766 (+1 ms)Writing region close event to WAL at 1676246609766Closed at 1676246609766 2023-02-13 00:03:29,766 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:29,767 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. after waiting 0 ms 2023-02-13 00:03:29,767 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:29,767 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:29,767 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ced57dbebf889853620545c25b19a141: Waiting for close lock at 1676246609766Disabling compacts and flushes for region at 1676246609766Disabling writes for close at 1676246609767 (+1 ms)Writing region close event to WAL at 1676246609767Closed at 1676246609767 2023-02-13 00:03:29,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:29,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5fd8d083355a03b05437fe4a6ddb21ec, disabling compactions & flushes 2023-02-13 00:03:29,783 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:29,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:29,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. after waiting 0 ms 2023-02-13 00:03:29,784 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:29,784 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:29,784 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5fd8d083355a03b05437fe4a6ddb21ec: Waiting for close lock at 1676246609783Disabling compacts and flushes for region at 1676246609783Disabling writes for close at 1676246609784 (+1 ms)Writing region close event to WAL at 1676246609784Closed at 1676246609784 2023-02-13 00:03:29,789 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:29,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676246609565.a5008e8e7077dcb7a211705461185553.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246609790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246609790"}]},"ts":"1676246609790"} 2023-02-13 00:03:29,841 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 00:03:29,843 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:29,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246609843"}]},"ts":"1676246609843"} 2023-02-13 00:03:29,846 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 00:03:29,850 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:29,864 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:29,864 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:29,864 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:29,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, ASSIGN}] 2023-02-13 00:03:29,870 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, ASSIGN 2023-02-13 00:03:29,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, ASSIGN 2023-02-13 00:03:29,871 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, ASSIGN 2023-02-13 00:03:29,871 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, ASSIGN 2023-02-13 00:03:29,872 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, ASSIGN 2023-02-13 00:03:29,872 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38931,1676246606668; forceNewPlan=false, retain=false 2023-02-13 00:03:29,872 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42817,1676246606714; forceNewPlan=false, retain=false 2023-02-13 00:03:29,873 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42817,1676246606714; forceNewPlan=false, retain=false 2023-02-13 00:03:29,873 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38931,1676246606668; forceNewPlan=false, retain=false 2023-02-13 00:03:29,873 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38931,1676246606668; forceNewPlan=false, retain=false 2023-02-13 00:03:29,873 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, ASSIGN 2023-02-13 00:03:29,874 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, ASSIGN 2023-02-13 00:03:29,874 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, ASSIGN 2023-02-13 00:03:29,875 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, ASSIGN 2023-02-13 00:03:29,875 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42817,1676246606714; forceNewPlan=false, retain=false 2023-02-13 00:03:29,875 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42817,1676246606714; forceNewPlan=false, retain=false 2023-02-13 00:03:29,875 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, ASSIGN 2023-02-13 00:03:29,876 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42817,1676246606714; forceNewPlan=false, retain=false 2023-02-13 00:03:29,876 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38931,1676246606668; forceNewPlan=false, retain=false 2023-02-13 00:03:29,877 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38931,1676246606668; forceNewPlan=false, retain=false 2023-02-13 00:03:29,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:30,022 INFO [jenkins-hbase4:43853] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 00:03:30,027 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a8d913dcb78336766996717a08757b81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,027 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=34e9215f152c749d1b2855bf5988c248, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e2f1890c8e2d83f800fa4dfa489f5d90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,027 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=80cbbd1557f99d8399d9bef4febabb4d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,027 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610026"}]},"ts":"1676246610026"} 2023-02-13 00:03:30,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610026"}]},"ts":"1676246610026"} 2023-02-13 00:03:30,027 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610026"}]},"ts":"1676246610026"} 2023-02-13 00:03:30,027 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=5fd8d083355a03b05437fe4a6ddb21ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,027 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610026"}]},"ts":"1676246610026"} 2023-02-13 00:03:30,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246610026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610026"}]},"ts":"1676246610026"} 2023-02-13 00:03:30,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 34e9215f152c749d1b2855bf5988c248, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:30,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 80cbbd1557f99d8399d9bef4febabb4d, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:30,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure e2f1890c8e2d83f800fa4dfa489f5d90, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:30,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure a8d913dcb78336766996717a08757b81, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:30,037 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0e7c1f9de8c918de0f291881e0de540b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,037 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610037"}]},"ts":"1676246610037"} 2023-02-13 00:03:30,039 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ced57dbebf889853620545c25b19a141, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,039 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610039"}]},"ts":"1676246610039"} 2023-02-13 00:03:30,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 5fd8d083355a03b05437fe4a6ddb21ec, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:30,042 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e2c1534c85d18491550a0e42706666ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,042 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610042"}]},"ts":"1676246610042"} 2023-02-13 00:03:30,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 0e7c1f9de8c918de0f291881e0de540b, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:30,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure ced57dbebf889853620545c25b19a141, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:30,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a5008e8e7077dcb7a211705461185553, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676246609565.a5008e8e7077dcb7a211705461185553.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610045"}]},"ts":"1676246610045"} 2023-02-13 00:03:30,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure e2c1534c85d18491550a0e42706666ed, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:30,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5fbc423bd225efe8d3c0c264305faab3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246610048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246610048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246610048"}]},"ts":"1676246610048"} 2023-02-13 00:03:30,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure a5008e8e7077dcb7a211705461185553, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:30,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 5fbc423bd225efe8d3c0c264305faab3, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:30,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:30,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34e9215f152c749d1b2855bf5988c248, NAME => 'testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 00:03:30,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,194 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,208 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1 2023-02-13 00:03:30,208 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1 2023-02-13 00:03:30,208 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e9215f152c749d1b2855bf5988c248 columnFamilyName f1 2023-02-13 00:03:30,209 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(310): Store=34e9215f152c749d1b2855bf5988c248/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,210 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,212 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2 2023-02-13 00:03:30,212 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2 2023-02-13 00:03:30,213 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e9215f152c749d1b2855bf5988c248 columnFamilyName f2 2023-02-13 00:03:30,214 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(310): Store=34e9215f152c749d1b2855bf5988c248/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:30,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:30,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0e7c1f9de8c918de0f291881e0de540b, NAME => 'testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 00:03:30,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,223 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,225 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1 2023-02-13 00:03:30,225 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1 2023-02-13 00:03:30,226 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e7c1f9de8c918de0f291881e0de540b columnFamilyName f1 2023-02-13 00:03:30,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,227 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(310): Store=0e7c1f9de8c918de0f291881e0de540b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,227 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:30,229 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2 2023-02-13 00:03:30,229 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2 2023-02-13 00:03:30,230 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e7c1f9de8c918de0f291881e0de540b columnFamilyName f2 2023-02-13 00:03:30,231 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(310): Store=0e7c1f9de8c918de0f291881e0de540b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34e9215f152c749d1b2855bf5988c248; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72696334, jitterRate=0.08325979113578796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34e9215f152c749d1b2855bf5988c248: Running coprocessor pre-open hook at 1676246610192Writing region info on filesystem at 1676246610192Initializing all the Stores at 1676246610193 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610193Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610194 (+1 ms)Cleaning up temporary data from old regions at 1676246610224 (+30 ms)Cleaning up detritus from prior splits at 1676246610225 (+1 ms)Running coprocessor post-open hooks at 1676246610234 (+9 ms)Region opened successfully at 1676246610234 2023-02-13 00:03:30,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248., pid=21, masterSystemTime=1676246610184 2023-02-13 00:03:30,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:30,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:30,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:30,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 80cbbd1557f99d8399d9bef4febabb4d, NAME => 'testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 00:03:30,241 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=34e9215f152c749d1b2855bf5988c248, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,241 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610241"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610241"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610241"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610241"}]},"ts":"1676246610241"} 2023-02-13 00:03:30,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:30,244 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,248 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1 2023-02-13 00:03:30,248 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1 2023-02-13 00:03:30,249 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80cbbd1557f99d8399d9bef4febabb4d columnFamilyName f1 2023-02-13 00:03:30,250 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(310): Store=80cbbd1557f99d8399d9bef4febabb4d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,250 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-13 00:03:30,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 34e9215f152c749d1b2855bf5988c248, server=jenkins-hbase4.apache.org,42817,1676246606714 in 215 msec 2023-02-13 00:03:30,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, ASSIGN in 387 msec 2023-02-13 00:03:30,254 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2 2023-02-13 00:03:30,254 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2 2023-02-13 00:03:30,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,255 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80cbbd1557f99d8399d9bef4febabb4d columnFamilyName f2 2023-02-13 00:03:30,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0e7c1f9de8c918de0f291881e0de540b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69203520, jitterRate=0.031212806701660156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0e7c1f9de8c918de0f291881e0de540b: Running coprocessor pre-open hook at 1676246610222Writing region info on filesystem at 1676246610222Initializing all the Stores at 1676246610223 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610223Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610223Cleaning up temporary data from old regions at 1676246610236 (+13 ms)Cleaning up detritus from prior splits at 1676246610237 (+1 ms)Running coprocessor post-open hooks at 1676246610256 (+19 ms)Region opened successfully at 1676246610256 2023-02-13 00:03:30,256 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(310): Store=80cbbd1557f99d8399d9bef4febabb4d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b., pid=26, masterSystemTime=1676246610203 2023-02-13 00:03:30,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:30,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:30,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:30,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:30,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2c1534c85d18491550a0e42706666ed, NAME => 'testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 00:03:30,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,303 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0e7c1f9de8c918de0f291881e0de540b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,303 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610303"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610303"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610303"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610303"}]},"ts":"1676246610303"} 2023-02-13 00:03:30,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 80cbbd1557f99d8399d9bef4febabb4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61954377, jitterRate=-0.07680784165859222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 80cbbd1557f99d8399d9bef4febabb4d: Running coprocessor pre-open hook at 1676246610242Writing region info on filesystem at 1676246610242Initializing all the Stores at 1676246610244 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610244Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610244Cleaning up temporary data from old regions at 1676246610261 (+17 ms)Cleaning up detritus from prior splits at 1676246610262 (+1 ms)Running coprocessor post-open hooks at 1676246610310 (+48 ms)Region opened successfully at 1676246610310 2023-02-13 00:03:30,310 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d., pid=22, masterSystemTime=1676246610184 2023-02-13 00:03:30,315 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1 2023-02-13 00:03:30,315 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1 2023-02-13 00:03:30,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:30,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:30,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:30,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fd8d083355a03b05437fe4a6ddb21ec, NAME => 'testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 00:03:30,316 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c1534c85d18491550a0e42706666ed columnFamilyName f1 2023-02-13 00:03:30,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,317 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(310): Store=e2c1534c85d18491550a0e42706666ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-13 00:03:30,318 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 0e7c1f9de8c918de0f291881e0de540b, server=jenkins-hbase4.apache.org,38931,1676246606668 in 268 msec 2023-02-13 00:03:30,318 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=80cbbd1557f99d8399d9bef4febabb4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,319 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610318"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610318"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610318"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610318"}]},"ts":"1676246610318"} 2023-02-13 00:03:30,320 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, ASSIGN in 453 msec 2023-02-13 00:03:30,322 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2 2023-02-13 00:03:30,323 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2 2023-02-13 00:03:30,323 DEBUG [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f1 2023-02-13 00:03:30,324 DEBUG [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f1 2023-02-13 00:03:30,324 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c1534c85d18491550a0e42706666ed columnFamilyName f2 2023-02-13 00:03:30,324 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fd8d083355a03b05437fe4a6ddb21ec columnFamilyName f1 2023-02-13 00:03:30,326 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(310): Store=5fd8d083355a03b05437fe4a6ddb21ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,326 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(310): Store=e2c1534c85d18491550a0e42706666ed/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,326 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-13 00:03:30,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 80cbbd1557f99d8399d9bef4febabb4d, server=jenkins-hbase4.apache.org,42817,1676246606714 in 291 msec 2023-02-13 00:03:30,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,329 DEBUG [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f2 2023-02-13 00:03:30,329 DEBUG [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f2 2023-02-13 00:03:30,329 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fd8d083355a03b05437fe4a6ddb21ec columnFamilyName f2 2023-02-13 00:03:30,332 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(310): Store=5fd8d083355a03b05437fe4a6ddb21ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, ASSIGN in 464 msec 2023-02-13 00:03:30,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:30,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2c1534c85d18491550a0e42706666ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63120965, jitterRate=-0.059424325823783875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2c1534c85d18491550a0e42706666ed: Running coprocessor pre-open hook at 1676246610303Writing region info on filesystem at 1676246610303Initializing all the Stores at 1676246610309 (+6 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610310 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610310Cleaning up temporary data from old regions at 1676246610329 (+19 ms)Cleaning up detritus from prior splits at 1676246610332 (+3 ms)Running coprocessor post-open hooks at 1676246610341 (+9 ms)Region opened successfully at 1676246610341 2023-02-13 00:03:30,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:30,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed., pid=28, masterSystemTime=1676246610203 2023-02-13 00:03:30,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:30,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:30,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:30,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a5008e8e7077dcb7a211705461185553, NAME => 'testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 00:03:30,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5fd8d083355a03b05437fe4a6ddb21ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74118524, jitterRate=0.10445207357406616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e2c1534c85d18491550a0e42706666ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5fd8d083355a03b05437fe4a6ddb21ec: Running coprocessor pre-open hook at 1676246610317Writing region info on filesystem at 1676246610317Initializing all the Stores at 1676246610319 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610319Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610320 (+1 ms)Cleaning up temporary data from old regions at 1676246610336 (+16 ms)Cleaning up detritus from prior splits at 1676246610336Running coprocessor post-open hooks at 1676246610346 (+10 ms)Region opened successfully at 1676246610346 2023-02-13 00:03:30,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610345"}]},"ts":"1676246610345"} 2023-02-13 00:03:30,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec., pid=25, masterSystemTime=1676246610184 2023-02-13 00:03:30,348 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:30,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:30,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:30,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2f1890c8e2d83f800fa4dfa489f5d90, NAME => 'testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 00:03:30,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,351 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1 2023-02-13 00:03:30,351 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1 2023-02-13 00:03:30,352 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=5fd8d083355a03b05437fe4a6ddb21ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,352 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5008e8e7077dcb7a211705461185553 columnFamilyName f1 2023-02-13 00:03:30,352 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246610352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610352"}]},"ts":"1676246610352"} 2023-02-13 00:03:30,353 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(310): Store=a5008e8e7077dcb7a211705461185553/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,353 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,354 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-13 00:03:30,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure e2c1534c85d18491550a0e42706666ed, server=jenkins-hbase4.apache.org,38931,1676246606668 in 303 msec 2023-02-13 00:03:30,357 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1 2023-02-13 00:03:30,357 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1 2023-02-13 00:03:30,357 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2f1890c8e2d83f800fa4dfa489f5d90 columnFamilyName f1 2023-02-13 00:03:30,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, ASSIGN in 491 msec 2023-02-13 00:03:30,358 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(310): Store=e2f1890c8e2d83f800fa4dfa489f5d90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,358 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2 2023-02-13 00:03:30,358 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2 2023-02-13 00:03:30,358 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,359 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5008e8e7077dcb7a211705461185553 columnFamilyName f2 2023-02-13 00:03:30,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-13 00:03:30,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 5fd8d083355a03b05437fe4a6ddb21ec, server=jenkins-hbase4.apache.org,42817,1676246606714 in 315 msec 2023-02-13 00:03:30,360 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(310): Store=a5008e8e7077dcb7a211705461185553/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,362 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2 2023-02-13 00:03:30,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,362 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2 2023-02-13 00:03:30,362 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2f1890c8e2d83f800fa4dfa489f5d90 columnFamilyName f2 2023-02-13 00:03:30,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, ASSIGN in 495 msec 2023-02-13 00:03:30,363 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(310): Store=e2f1890c8e2d83f800fa4dfa489f5d90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:30,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:30,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a5008e8e7077dcb7a211705461185553; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70683701, jitterRate=0.053269222378730774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a5008e8e7077dcb7a211705461185553: Running coprocessor pre-open hook at 1676246610346Writing region info on filesystem at 1676246610346Initializing all the Stores at 1676246610347 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610348 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610348Cleaning up temporary data from old regions at 1676246610364 (+16 ms)Cleaning up detritus from prior splits at 1676246610365 (+1 ms)Running coprocessor post-open hooks at 1676246610374 (+9 ms)Region opened successfully at 1676246610374 2023-02-13 00:03:30,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553., pid=29, masterSystemTime=1676246610203 2023-02-13 00:03:30,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2f1890c8e2d83f800fa4dfa489f5d90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73703050, jitterRate=0.0982610285282135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:30,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2f1890c8e2d83f800fa4dfa489f5d90: Running coprocessor pre-open hook at 1676246610351Writing region info on filesystem at 1676246610351Initializing all the Stores at 1676246610353 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610353Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610353Cleaning up temporary data from old regions at 1676246610367 (+14 ms)Cleaning up detritus from prior splits at 1676246610369 (+2 ms)Running coprocessor post-open hooks at 1676246610378 (+9 ms)Region opened successfully at 1676246610378 2023-02-13 00:03:30,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:30,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ced57dbebf889853620545c25b19a141, NAME => 'testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 00:03:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90., pid=23, masterSystemTime=1676246610184 2023-02-13 00:03:30,380 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a5008e8e7077dcb7a211705461185553, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,381 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676246609565.a5008e8e7077dcb7a211705461185553.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610380"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610380"}]},"ts":"1676246610380"} 2023-02-13 00:03:30,382 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:30,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:30,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:30,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a8d913dcb78336766996717a08757b81, NAME => 'testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 00:03:30,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e2f1890c8e2d83f800fa4dfa489f5d90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,384 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1 2023-02-13 00:03:30,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610384"}]},"ts":"1676246610384"} 2023-02-13 00:03:30,385 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1 2023-02-13 00:03:30,386 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ced57dbebf889853620545c25b19a141 columnFamilyName f1 2023-02-13 00:03:30,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-13 00:03:30,387 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(310): Store=ced57dbebf889853620545c25b19a141/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure a5008e8e7077dcb7a211705461185553, server=jenkins-hbase4.apache.org,38931,1676246606668 in 334 msec 2023-02-13 00:03:30,388 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,390 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2 2023-02-13 00:03:30,390 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2 2023-02-13 00:03:30,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, ASSIGN in 523 msec 2023-02-13 00:03:30,391 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ced57dbebf889853620545c25b19a141 columnFamilyName f2 2023-02-13 00:03:30,391 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(310): Store=ced57dbebf889853620545c25b19a141/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-13 00:03:30,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure e2f1890c8e2d83f800fa4dfa489f5d90, server=jenkins-hbase4.apache.org,42817,1676246606714 in 354 msec 2023-02-13 00:03:30,417 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, ASSIGN in 528 msec 2023-02-13 00:03:30,419 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1 2023-02-13 00:03:30,420 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1 2023-02-13 00:03:30,420 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8d913dcb78336766996717a08757b81 columnFamilyName f1 2023-02-13 00:03:30,421 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(310): Store=a8d913dcb78336766996717a08757b81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,421 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,423 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2 2023-02-13 00:03:30,424 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2 2023-02-13 00:03:30,424 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8d913dcb78336766996717a08757b81 columnFamilyName f2 2023-02-13 00:03:30,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,425 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(310): Store=a8d913dcb78336766996717a08757b81/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ced57dbebf889853620545c25b19a141 2023-02-13 00:03:30,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a8d913dcb78336766996717a08757b81 2023-02-13 00:03:30,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a8d913dcb78336766996717a08757b81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59199310, jitterRate=-0.1178615391254425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ced57dbebf889853620545c25b19a141; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63205230, jitterRate=-0.0581686794757843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a8d913dcb78336766996717a08757b81: Running coprocessor pre-open hook at 1676246610384Writing region info on filesystem at 1676246610384Initializing all the Stores at 1676246610386 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610386Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610395 (+9 ms)Cleaning up temporary data from old regions at 1676246610430 (+35 ms)Cleaning up detritus from prior splits at 1676246610431 (+1 ms)Running coprocessor post-open hooks at 1676246610451 (+20 ms)Region opened successfully at 1676246610451 2023-02-13 00:03:30,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ced57dbebf889853620545c25b19a141: Running coprocessor pre-open hook at 1676246610379Writing region info on filesystem at 1676246610379Initializing all the Stores at 1676246610381 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610381Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610381Cleaning up temporary data from old regions at 1676246610427 (+46 ms)Cleaning up detritus from prior splits at 1676246610427Running coprocessor post-open hooks at 1676246610451 (+24 ms)Region opened successfully at 1676246610451 2023-02-13 00:03:30,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141., pid=27, masterSystemTime=1676246610203 2023-02-13 00:03:30,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81., pid=24, masterSystemTime=1676246610184 2023-02-13 00:03:30,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:30,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:30,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:30,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fbc423bd225efe8d3c0c264305faab3, NAME => 'testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 00:03:30,461 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ced57dbebf889853620545c25b19a141, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:30,461 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610461"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610461"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610461"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610461"}]},"ts":"1676246610461"} 2023-02-13 00:03:30,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:30,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:30,464 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a8d913dcb78336766996717a08757b81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:30,464 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246610464"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610464"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610464"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610464"}]},"ts":"1676246610464"} 2023-02-13 00:03:30,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-13 00:03:30,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure ced57dbebf889853620545c25b19a141, server=jenkins-hbase4.apache.org,38931,1676246606668 in 419 msec 2023-02-13 00:03:30,473 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-13 00:03:30,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure a8d913dcb78336766996717a08757b81, server=jenkins-hbase4.apache.org,42817,1676246606714 in 435 msec 2023-02-13 00:03:30,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, ASSIGN in 608 msec 2023-02-13 00:03:30,477 DEBUG [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f1 2023-02-13 00:03:30,477 DEBUG [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f1 2023-02-13 00:03:30,477 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbc423bd225efe8d3c0c264305faab3 columnFamilyName f1 2023-02-13 00:03:30,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, ASSIGN in 612 msec 2023-02-13 00:03:30,481 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(310): Store=5fbc423bd225efe8d3c0c264305faab3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,481 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,484 DEBUG [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f2 2023-02-13 00:03:30,484 DEBUG [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f2 2023-02-13 00:03:30,484 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbc423bd225efe8d3c0c264305faab3 columnFamilyName f2 2023-02-13 00:03:30,485 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(310): Store=5fbc423bd225efe8d3c0c264305faab3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:30,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:30,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:30,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5fbc423bd225efe8d3c0c264305faab3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65319112, jitterRate=-0.02666938304901123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5fbc423bd225efe8d3c0c264305faab3: Running coprocessor pre-open hook at 1676246610461Writing region info on filesystem at 1676246610461Initializing all the Stores at 1676246610463 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610463Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246610466 (+3 ms)Cleaning up temporary data from old regions at 1676246610488 (+22 ms)Cleaning up detritus from prior splits at 1676246610488Running coprocessor post-open hooks at 1676246610494 (+6 ms)Region opened successfully at 1676246610494 2023-02-13 00:03:30,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3., pid=30, masterSystemTime=1676246610203 2023-02-13 00:03:30,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:30,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:30,499 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5fbc423bd225efe8d3c0c264305faab3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:30,499 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246610499"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246610499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246610499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246610499"}]},"ts":"1676246610499"} 2023-02-13 00:03:30,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-13 00:03:30,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 5fbc423bd225efe8d3c0c264305faab3, server=jenkins-hbase4.apache.org,38931,1676246606668 in 450 msec 2023-02-13 00:03:30,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 00:03:30,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, ASSIGN in 641 msec 2023-02-13 00:03:30,509 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:30,509 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246610509"}]},"ts":"1676246610509"} 2023-02-13 00:03:30,511 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 00:03:30,514 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:30,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 944 msec 2023-02-13 00:03:30,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:30,724 INFO [Listener at localhost/40573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 00:03:30,724 DEBUG [Listener at localhost/40573] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 00:03:30,726 INFO [Listener at localhost/40573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:30,733 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 00:03:30,734 INFO [Listener at localhost/40573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:30,734 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 00:03:30,734 INFO [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:03:30,866 DEBUG [hconnection-0x6b5959b0-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:30,939 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59912, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:30,985 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38931] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:30,988 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:31,280 INFO [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:03:31,285 INFO [Listener at localhost/40573] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:03:31,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:03:31,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246611299 (current time:1676246611299). 2023-02-13 00:03:31,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:03:31,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] zookeeper.ReadOnlyZKClient(139): Connect 0x222dc126 to 127.0.0.1:53518 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:31,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ee5b163, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:31,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:31,318 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:31,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x222dc126 to 127.0.0.1:53518 2023-02-13 00:03:31,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:31,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:03:31,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:03:31,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:03:31,346 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:03:31,348 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676247211348 2023-02-13 00:03:31,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:03:31,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 00:03:31,350 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:03:31,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:03:31,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 14 msec 2023-02-13 00:03:31,353 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:03:31,354 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676247211354 2023-02-13 00:03:31,355 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:31,355 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:03:31,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-13 00:03:31,415 INFO [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-13 00:03:31,415 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:31,416 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-13 00:03:31,416 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 00:03:31,417 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:31,417 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:31,418 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:31,418 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:31,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:31,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:31,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:31,420 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 00:03:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:31,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 00:03:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 00:03:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:31,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 00:03:31,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 00:03:31,425 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,425 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,425 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 00:03:31,426 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:31,426 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 00:03:31,426 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 00:03:31,426 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42817,1676246606714' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 00:03:31,428 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,428 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:31,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 00:03:31,431 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,431 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:31,431 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,432 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:31,432 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 00:03:31,432 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:31,432 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 00:03:31,432 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 00:03:31,433 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38931,1676246606668' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 00:03:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,436 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:31,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42817,1676246606714' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 00:03:31,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77457bb2[Count = 1] remaining members to acquire global barrier 2023-02-13 00:03:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:31,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:31,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38931,1676246606668' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 00:03:31,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77457bb2[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:31,441 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 00:03:31,442 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:31,444 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:31,444 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:31,444 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:31,445 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:31,445 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:31,445 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:31,446 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. started... 2023-02-13 00:03:31,446 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. started... 2023-02-13 00:03:31,447 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:31,452 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 00:03:31,452 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:31,452 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e2f1890c8e2d83f800fa4dfa489f5d90 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:31,452 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. started... 2023-02-13 00:03:31,452 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:31,454 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:31,454 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 80cbbd1557f99d8399d9bef4febabb4d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 00:03:31,454 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. started... 2023-02-13 00:03:31,455 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:31,455 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:31,455 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:31,455 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e2c1534c85d18491550a0e42706666ed 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:31,455 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 00:03:31,456 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:31,455 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5fd8d083355a03b05437fe4a6ddb21ec: 2023-02-13 00:03:31,455 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. started... 2023-02-13 00:03:31,455 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. started... 2023-02-13 00:03:31,456 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5fbc423bd225efe8d3c0c264305faab3: 2023-02-13 00:03:31,457 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ced57dbebf889853620545c25b19a141 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 00:03:31,458 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,458 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:31,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:31,464 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:03:31,464 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,464 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,470 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:31,470 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:31,470 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:31,470 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:31,509 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. completed. 2023-02-13 00:03:31,509 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. completed. 2023-02-13 00:03:31,510 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:31,509 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:31,512 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 00:03:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 00:03:31,512 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. started... 2023-02-13 00:03:31,512 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:31,513 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. started... 2023-02-13 00:03:31,514 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a5008e8e7077dcb7a211705461185553 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:31,514 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a8d913dcb78336766996717a08757b81 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:31,664 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:31,666 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 00:03:31,724 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f1/f3f326e43a794dafaad4be0bba77b74d 2023-02-13 00:03:31,746 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f1/97a012438e52429e9a040ab0c07f2604 2023-02-13 00:03:31,756 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f1/48ec01783eee49389e79a9597fe27783 2023-02-13 00:03:31,758 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f1/043508614db845fc860f41e2af08ec54 2023-02-13 00:03:31,762 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f1/9a5f25828c294cf6a2a2180ecc7c0fef 2023-02-13 00:03:31,906 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f2/a6abdb3fb1d44a298d17ad16e54593b3 2023-02-13 00:03:31,914 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f2/4f6bbec372354358b8fbe50ef0f2ce36 2023-02-13 00:03:31,916 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f2/dbdeca7b6c6248c3ac9d995fcbaad566 2023-02-13 00:03:31,917 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f2/d5d793de80a748fc9e61e49b9030d974 2023-02-13 00:03:31,918 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f1/9a5f25828c294cf6a2a2180ecc7c0fef as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/9a5f25828c294cf6a2a2180ecc7c0fef 2023-02-13 00:03:31,919 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f2/23e80fc8c3f844da928a0b1072e5e6bf 2023-02-13 00:03:31,928 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f1/97a012438e52429e9a040ab0c07f2604 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/97a012438e52429e9a040ab0c07f2604 2023-02-13 00:03:31,931 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f1/043508614db845fc860f41e2af08ec54 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/043508614db845fc860f41e2af08ec54 2023-02-13 00:03:31,931 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f1/f3f326e43a794dafaad4be0bba77b74d as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/f3f326e43a794dafaad4be0bba77b74d 2023-02-13 00:03:31,934 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f1/48ec01783eee49389e79a9597fe27783 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/48ec01783eee49389e79a9597fe27783 2023-02-13 00:03:31,936 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/9a5f25828c294cf6a2a2180ecc7c0fef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:31,939 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f2/a6abdb3fb1d44a298d17ad16e54593b3 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/a6abdb3fb1d44a298d17ad16e54593b3 2023-02-13 00:03:31,943 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/f3f326e43a794dafaad4be0bba77b74d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:31,945 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/043508614db845fc860f41e2af08ec54, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:31,946 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/97a012438e52429e9a040ab0c07f2604, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:31,947 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f2/4f6bbec372354358b8fbe50ef0f2ce36 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/4f6bbec372354358b8fbe50ef0f2ce36 2023-02-13 00:03:31,947 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f2/d5d793de80a748fc9e61e49b9030d974 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/d5d793de80a748fc9e61e49b9030d974 2023-02-13 00:03:31,948 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/48ec01783eee49389e79a9597fe27783, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:31,948 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f2/dbdeca7b6c6248c3ac9d995fcbaad566 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/dbdeca7b6c6248c3ac9d995fcbaad566 2023-02-13 00:03:31,949 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f2/23e80fc8c3f844da928a0b1072e5e6bf as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/23e80fc8c3f844da928a0b1072e5e6bf 2023-02-13 00:03:31,957 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/a6abdb3fb1d44a298d17ad16e54593b3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:31,957 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/d5d793de80a748fc9e61e49b9030d974, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:31,959 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a8d913dcb78336766996717a08757b81 in 445ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:31,960 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 00:03:31,962 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/4f6bbec372354358b8fbe50ef0f2ce36, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:31,962 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a8d913dcb78336766996717a08757b81: 2023-02-13 00:03:31,963 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,963 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,963 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/9a5f25828c294cf6a2a2180ecc7c0fef] hfiles 2023-02-13 00:03:31,963 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/9a5f25828c294cf6a2a2180ecc7c0fef for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,963 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e2c1534c85d18491550a0e42706666ed in 508ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e2c1534c85d18491550a0e42706666ed: 2023-02-13 00:03:31,964 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 80cbbd1557f99d8399d9bef4febabb4d in 510ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 80cbbd1557f99d8399d9bef4febabb4d: 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/043508614db845fc860f41e2af08ec54] hfiles 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/043508614db845fc860f41e2af08ec54 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,964 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,965 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/dbdeca7b6c6248c3ac9d995fcbaad566, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:31,965 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/f3f326e43a794dafaad4be0bba77b74d] hfiles 2023-02-13 00:03:31,965 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/f3f326e43a794dafaad4be0bba77b74d for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,966 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ced57dbebf889853620545c25b19a141 in 508ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:31,966 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ced57dbebf889853620545c25b19a141: 2023-02-13 00:03:31,966 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,966 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,966 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/97a012438e52429e9a040ab0c07f2604] hfiles 2023-02-13 00:03:31,966 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/97a012438e52429e9a040ab0c07f2604 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,966 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:31,967 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/23e80fc8c3f844da928a0b1072e5e6bf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:31,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:31,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:31,968 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 00:03:31,969 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a5008e8e7077dcb7a211705461185553 in 455ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a5008e8e7077dcb7a211705461185553: 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/d5d793de80a748fc9e61e49b9030d974] hfiles 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/a6abdb3fb1d44a298d17ad16e54593b3] hfiles 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/4f6bbec372354358b8fbe50ef0f2ce36] hfiles 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/dbdeca7b6c6248c3ac9d995fcbaad566] hfiles 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/4f6bbec372354358b8fbe50ef0f2ce36 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/a6abdb3fb1d44a298d17ad16e54593b3 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:31,969 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/d5d793de80a748fc9e61e49b9030d974 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/48ec01783eee49389e79a9597fe27783] hfiles 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/dbdeca7b6c6248c3ac9d995fcbaad566 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/48ec01783eee49389e79a9597fe27783 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/23e80fc8c3f844da928a0b1072e5e6bf] hfiles 2023-02-13 00:03:31,970 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/23e80fc8c3f844da928a0b1072e5e6bf for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:31,999 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. completed. 2023-02-13 00:03:31,999 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:31,999 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:32,000 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. started... 2023-02-13 00:03:32,000 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 00:03:32,000 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0e7c1f9de8c918de0f291881e0de540b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:32,000 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. completed. 2023-02-13 00:03:32,001 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:32,001 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 00:03:32,005 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. completed. 2023-02-13 00:03:32,005 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:32,005 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:32,005 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 00:03:32,005 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. started... 2023-02-13 00:03:32,006 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 34e9215f152c749d1b2855bf5988c248 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:32,029 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f1/20be9a6dfd214157b1f305840770a217 2023-02-13 00:03:32,029 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f1/89a26f51c0af481ebe961fb5d5c33d79 2023-02-13 00:03:32,076 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f2/7bbaa3b7498d40fd8a7c4866fc72f852 2023-02-13 00:03:32,085 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f1/89a26f51c0af481ebe961fb5d5c33d79 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/89a26f51c0af481ebe961fb5d5c33d79 2023-02-13 00:03:32,086 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f2/4d4ad6e919c241b68af90d7723ce8734 2023-02-13 00:03:32,093 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/89a26f51c0af481ebe961fb5d5c33d79, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:32,094 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f2/7bbaa3b7498d40fd8a7c4866fc72f852 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/7bbaa3b7498d40fd8a7c4866fc72f852 2023-02-13 00:03:32,094 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f1/20be9a6dfd214157b1f305840770a217 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/20be9a6dfd214157b1f305840770a217 2023-02-13 00:03:32,102 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/20be9a6dfd214157b1f305840770a217, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:32,104 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f2/4d4ad6e919c241b68af90d7723ce8734 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/4d4ad6e919c241b68af90d7723ce8734 2023-02-13 00:03:32,107 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/7bbaa3b7498d40fd8a7c4866fc72f852, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:32,109 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 34e9215f152c749d1b2855bf5988c248 in 104ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:32,109 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 34e9215f152c749d1b2855bf5988c248: 2023-02-13 00:03:32,110 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,110 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:32,110 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/89a26f51c0af481ebe961fb5d5c33d79] hfiles 2023-02-13 00:03:32,110 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/89a26f51c0af481ebe961fb5d5c33d79 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,110 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/7bbaa3b7498d40fd8a7c4866fc72f852] hfiles 2023-02-13 00:03:32,110 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/7bbaa3b7498d40fd8a7c4866fc72f852 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,117 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/4d4ad6e919c241b68af90d7723ce8734, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:32,118 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0e7c1f9de8c918de0f291881e0de540b in 118ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0e7c1f9de8c918de0f291881e0de540b: 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/20be9a6dfd214157b1f305840770a217] hfiles 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/20be9a6dfd214157b1f305840770a217 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/4d4ad6e919c241b68af90d7723ce8734] hfiles 2023-02-13 00:03:32,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/4d4ad6e919c241b68af90d7723ce8734 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,144 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. completed. 2023-02-13 00:03:32,144 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:32,144 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 00:03:32,163 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. completed. 2023-02-13 00:03:32,163 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 00:03:32,166 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f1/350e1dc8e8734097b6e1917c1a6fed64 2023-02-13 00:03:32,188 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f2/a715872ef0a34510931d424c7f09ba3d 2023-02-13 00:03:32,199 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f1/350e1dc8e8734097b6e1917c1a6fed64 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/350e1dc8e8734097b6e1917c1a6fed64 2023-02-13 00:03:32,207 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/350e1dc8e8734097b6e1917c1a6fed64, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:32,208 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f2/a715872ef0a34510931d424c7f09ba3d as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a715872ef0a34510931d424c7f09ba3d 2023-02-13 00:03:32,216 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a715872ef0a34510931d424c7f09ba3d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:32,217 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e2f1890c8e2d83f800fa4dfa489f5d90 in 765ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:32,217 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e2f1890c8e2d83f800fa4dfa489f5d90: 2023-02-13 00:03:32,218 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,218 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:32,218 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/350e1dc8e8734097b6e1917c1a6fed64] hfiles 2023-02-13 00:03:32,218 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/350e1dc8e8734097b6e1917c1a6fed64 for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,218 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a715872ef0a34510931d424c7f09ba3d] hfiles 2023-02-13 00:03:32,218 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a715872ef0a34510931d424c7f09ba3d for snapshot=testWithMapReduceMultiRegion 2023-02-13 00:03:32,238 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. completed. 2023-02-13 00:03:32,238 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:32,238 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 00:03:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. completed. 2023-02-13 00:03:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 00:03:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 00:03:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 00:03:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42817,1676246606714' in zk 2023-02-13 00:03:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 00:03:32,406 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,406 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 00:03:32,407 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. completed. 2023-02-13 00:03:32,407 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:32,407 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 00:03:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 00:03:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 00:03:32,408 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38931,1676246606668' in zk 2023-02-13 00:03:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:32,411 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 00:03:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:32,411 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 00:03:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42817,1676246606714': 2023-02-13 00:03:32,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42817,1676246606714' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 00:03:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38931,1676246606668': 2023-02-13 00:03:32,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38931,1676246606668' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 00:03:32,422 INFO [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-13 00:03:32,422 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:32,422 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:32,423 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-13 00:03:32,423 INFO [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:03:32,426 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,426 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,426 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,426 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:32,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:32,426 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,427 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,428 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,430 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,431 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 00:03:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,448 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,448 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:32,448 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:32,448 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:32,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:32,449 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:32,449 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:32,449 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-13 00:03:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:32,449 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:32,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-13 00:03:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:32,450 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 00:03:32,452 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:32,452 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:32,452 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:32,452 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 00:03:32,452 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 00:03:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:32,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 00:03:32,469 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:32,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:32,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:32,471 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 00:03:32,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-13 00:03:32,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-13 00:03:32,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 00:03:32,605 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 00:03:32,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676246611349Consolidate snapshot: testWithMapReduceMultiRegion at 1676246612450 (+1101 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676246612450Writing data manifest for testWithMapReduceMultiRegion at 1676246612496 (+46 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676246612528 (+32 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676246612604 (+76 ms) 2023-02-13 00:03:32,606 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:03:32,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2570 sec 2023-02-13 00:03:33,471 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:33,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:33,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:03:33,485 INFO [Listener at localhost/40573] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:03:33,503 INFO [Listener at localhost/40573] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:03:33,516 INFO [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:03:33,573 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38931] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:33,577 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:33,716 INFO [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:03:33,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:03:33,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 00:03:33,741 INFO [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 00:03:33,741 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:33,742 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 00:03:33,742 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 00:03:33,743 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:33,743 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:33,744 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:33,744 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:33,744 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:33,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:33,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:33,745 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:33,746 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:33,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:33,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:33,746 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:33,747 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:33,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 00:03:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:33,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 00:03:33,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 00:03:33,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 00:03:33,751 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 00:03:33,751 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 00:03:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 00:03:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 00:03:33,756 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:33,756 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. started... 2023-02-13 00:03:33,756 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:33,756 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. started... 2023-02-13 00:03:33,756 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e2c1534c85d18491550a0e42706666ed 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:33,756 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e2f1890c8e2d83f800fa4dfa489f5d90 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:33,757 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:33,758 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. started... 2023-02-13 00:03:33,758 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ced57dbebf889853620545c25b19a141 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 00:03:33,758 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:33,758 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. started... 2023-02-13 00:03:33,759 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5fd8d083355a03b05437fe4a6ddb21ec: 2023-02-13 00:03:33,759 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 00:03:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:33,759 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 00:03:33,759 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:33,759 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:33,759 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. started... 2023-02-13 00:03:33,759 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a8d913dcb78336766996717a08757b81 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:33,759 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. started... 2023-02-13 00:03:33,761 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 80cbbd1557f99d8399d9bef4febabb4d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 00:03:33,764 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 00:03:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:33,770 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:33,770 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. started... 2023-02-13 00:03:33,770 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5fbc423bd225efe8d3c0c264305faab3: 2023-02-13 00:03:33,771 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:33,771 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:33,771 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. started... 2023-02-13 00:03:33,771 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a5008e8e7077dcb7a211705461185553 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:33,771 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 00:03:33,829 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f1/923b13ca4102445f9ca284adf9cebacc 2023-02-13 00:03:33,854 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f1/0cf90efd54d64ad096248de519e002ee 2023-02-13 00:03:33,868 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f1/d154c1619b9a4a12bec0c6559f2c9bc6 2023-02-13 00:03:33,878 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f1/ab666df376b94970b1997c37fb6365db 2023-02-13 00:03:33,880 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f1/9cc3a1461b5c40eb8998ce4f2c9ad300 2023-02-13 00:03:33,897 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f1/5c3c01c4ed824cb7b73d634144337e4a 2023-02-13 00:03:33,916 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f2/ccb50370d61047cf8a7834e3c32d8dab 2023-02-13 00:03:33,923 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f1/923b13ca4102445f9ca284adf9cebacc as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/923b13ca4102445f9ca284adf9cebacc 2023-02-13 00:03:33,930 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/923b13ca4102445f9ca284adf9cebacc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:33,932 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/.tmp/f2/ccb50370d61047cf8a7834e3c32d8dab as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/ccb50370d61047cf8a7834e3c32d8dab 2023-02-13 00:03:33,939 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/ccb50370d61047cf8a7834e3c32d8dab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:33,940 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a8d913dcb78336766996717a08757b81 in 181ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:33,940 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a8d913dcb78336766996717a08757b81: 2023-02-13 00:03:33,940 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:33,944 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:33,944 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. started... 2023-02-13 00:03:33,944 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 00:03:33,944 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34e9215f152c749d1b2855bf5988c248 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:33,960 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f2/dbb0eca21b4d40fdb8dcd848827cbca2 2023-02-13 00:03:33,965 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f2/a2cfe19cb5d94852b252f6d32d8bcf62 2023-02-13 00:03:33,968 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f2/a53ede9272ac45bc89294265fc3eb0e9 2023-02-13 00:03:33,980 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f2/5cfba2e6400245d9a6610e4faebcdf1d 2023-02-13 00:03:33,982 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f1/9cc3a1461b5c40eb8998ce4f2c9ad300 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/9cc3a1461b5c40eb8998ce4f2c9ad300 2023-02-13 00:03:33,983 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f1/d154c1619b9a4a12bec0c6559f2c9bc6 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/d154c1619b9a4a12bec0c6559f2c9bc6 2023-02-13 00:03:33,985 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f1/ca0d28d75fb44262af08968fc6b0e613 2023-02-13 00:03:33,985 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f1/0cf90efd54d64ad096248de519e002ee as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/0cf90efd54d64ad096248de519e002ee 2023-02-13 00:03:33,992 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/9cc3a1461b5c40eb8998ce4f2c9ad300, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:33,993 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 00:03:33,994 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f1/5c3c01c4ed824cb7b73d634144337e4a as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/5c3c01c4ed824cb7b73d634144337e4a 2023-02-13 00:03:33,996 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/d154c1619b9a4a12bec0c6559f2c9bc6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:33,999 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/.tmp/f2/a2cfe19cb5d94852b252f6d32d8bcf62 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/a2cfe19cb5d94852b252f6d32d8bcf62 2023-02-13 00:03:34,000 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/.tmp/f2/dbb0eca21b4d40fdb8dcd848827cbca2 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/dbb0eca21b4d40fdb8dcd848827cbca2 2023-02-13 00:03:34,000 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/0cf90efd54d64ad096248de519e002ee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,003 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/.tmp/f2/a53ede9272ac45bc89294265fc3eb0e9 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a53ede9272ac45bc89294265fc3eb0e9 2023-02-13 00:03:34,011 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/5c3c01c4ed824cb7b73d634144337e4a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:34,014 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/.tmp/f2/5cfba2e6400245d9a6610e4faebcdf1d as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/5cfba2e6400245d9a6610e4faebcdf1d 2023-02-13 00:03:34,023 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/a2cfe19cb5d94852b252f6d32d8bcf62, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:34,024 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ced57dbebf889853620545c25b19a141 in 266ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,024 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ced57dbebf889853620545c25b19a141: 2023-02-13 00:03:34,024 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:34,024 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:34,024 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 00:03:34,024 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. started... 2023-02-13 00:03:34,024 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0e7c1f9de8c918de0f291881e0de540b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:34,030 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/dbb0eca21b4d40fdb8dcd848827cbca2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,031 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e2c1534c85d18491550a0e42706666ed in 275ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,031 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e2c1534c85d18491550a0e42706666ed: 2023-02-13 00:03:34,031 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:34,031 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 00:03:34,047 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a53ede9272ac45bc89294265fc3eb0e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,049 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/5cfba2e6400245d9a6610e4faebcdf1d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:34,050 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e2f1890c8e2d83f800fa4dfa489f5d90 in 294ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,050 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e2f1890c8e2d83f800fa4dfa489f5d90: 2023-02-13 00:03:34,050 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:34,051 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 00:03:34,053 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f2/8cd84892fec64654abbab3c988a89086 2023-02-13 00:03:34,053 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 80cbbd1557f99d8399d9bef4febabb4d in 293ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,053 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80cbbd1557f99d8399d9bef4febabb4d: 2023-02-13 00:03:34,053 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:34,054 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 00:03:34,068 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f1/b22f84cf35e54e92b62b1b20182f62a6 2023-02-13 00:03:34,070 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f1/ca0d28d75fb44262af08968fc6b0e613 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/ca0d28d75fb44262af08968fc6b0e613 2023-02-13 00:03:34,077 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/ca0d28d75fb44262af08968fc6b0e613, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,078 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/.tmp/f2/8cd84892fec64654abbab3c988a89086 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/8cd84892fec64654abbab3c988a89086 2023-02-13 00:03:34,091 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/8cd84892fec64654abbab3c988a89086, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,098 INFO [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 34e9215f152c749d1b2855bf5988c248 in 154ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,099 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34e9215f152c749d1b2855bf5988c248: 2023-02-13 00:03:34,099 DEBUG [rs(jenkins-hbase4.apache.org,42817,1676246606714)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 00:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 00:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 00:03:34,099 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42817,1676246606714' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 00:03:34,102 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f2/d09eb24b769049c189477c95fbdeecfe 2023-02-13 00:03:34,102 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,102 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:34,103 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,103 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,110 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f1/b22f84cf35e54e92b62b1b20182f62a6 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/b22f84cf35e54e92b62b1b20182f62a6 2023-02-13 00:03:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:34,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42817,1676246606714' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 00:03:34,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65c003ff[Count = 1] remaining members to acquire global barrier 2023-02-13 00:03:34,113 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 00:03:34,115 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 00:03:34,118 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/b22f84cf35e54e92b62b1b20182f62a6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,119 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/.tmp/f2/d09eb24b769049c189477c95fbdeecfe as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/d09eb24b769049c189477c95fbdeecfe 2023-02-13 00:03:34,125 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/d09eb24b769049c189477c95fbdeecfe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,127 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0e7c1f9de8c918de0f291881e0de540b in 102ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,127 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0e7c1f9de8c918de0f291881e0de540b: 2023-02-13 00:03:34,127 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:34,127 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 00:03:34,365 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f2/6f06feef6cd74b76960f735eab10d53f 2023-02-13 00:03:34,372 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f1/ab666df376b94970b1997c37fb6365db as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/ab666df376b94970b1997c37fb6365db 2023-02-13 00:03:34,379 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/ab666df376b94970b1997c37fb6365db, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,380 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/.tmp/f2/6f06feef6cd74b76960f735eab10d53f as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/6f06feef6cd74b76960f735eab10d53f 2023-02-13 00:03:34,386 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/6f06feef6cd74b76960f735eab10d53f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:34,387 INFO [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a5008e8e7077dcb7a211705461185553 in 616ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:34,387 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a5008e8e7077dcb7a211705461185553: 2023-02-13 00:03:34,387 DEBUG [rs(jenkins-hbase4.apache.org,38931,1676246606668)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 00:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 00:03:34,387 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,388 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 00:03:34,388 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38931,1676246606668' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 00:03:34,389 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,389 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:34,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:34,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38931,1676246606668' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 00:03:34,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65c003ff[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:34,392 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 00:03:34,392 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,395 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,395 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,396 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 00:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 00:03:34,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42817,1676246606714' in zk 2023-02-13 00:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 00:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 00:03:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38931,1676246606668' in zk 2023-02-13 00:03:34,396 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,396 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:34,398 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 00:03:34,398 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,398 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:34,398 DEBUG [member: 'jenkins-hbase4.apache.org,42817,1676246606714' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 00:03:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 00:03:34,399 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,38931,1676246606668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 00:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42817,1676246606714': 2023-02-13 00:03:34,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42817,1676246606714' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 00:03:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38931,1676246606668': 2023-02-13 00:03:34,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38931,1676246606668' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 00:03:34,408 INFO [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 00:03:34,408 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:34,408 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:34,409 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 00:03:34,409 INFO [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:03:34,411 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:34,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:34,411 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:34,412 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:34,413 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:34,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,416 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:34,416 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,423 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,423 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:34,424 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:34,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:34,424 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:34,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 00:03:34,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:03:34,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:34,424 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:34,424 DEBUG [(jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:34,424 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:34,424 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:34,424 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:34,425 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:34,425 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:34,425 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:34,425 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:34,425 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:34,427 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:34,427 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:03:34,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:34,527 DEBUG [Listener at localhost/40573] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:03:34,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:03:34,631 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop-7848238748896877822.jar 2023-02-13 00:03:34,648 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676246611299 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:34,648 DEBUG [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce 2023-02-13 00:03:34,649 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:34,649 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:34,649 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: ced57dbebf889853620545c25b19a141 2023-02-13 00:03:34,649 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: a8d913dcb78336766996717a08757b81 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(239): region to add: 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=e2c1534c85d18491550a0e42706666ed as e2c1534c85d18491550a0e42706666ed in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=e2f1890c8e2d83f800fa4dfa489f5d90 as e2f1890c8e2d83f800fa4dfa489f5d90 in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=ced57dbebf889853620545c25b19a141 as ced57dbebf889853620545c25b19a141 in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=5fd8d083355a03b05437fe4a6ddb21ec as 5fd8d083355a03b05437fe4a6ddb21ec in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=5fbc423bd225efe8d3c0c264305faab3 as 5fbc423bd225efe8d3c0c264305faab3 in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=80cbbd1557f99d8399d9bef4febabb4d as 80cbbd1557f99d8399d9bef4febabb4d in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,650 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=a8d913dcb78336766996717a08757b81 as a8d913dcb78336766996717a08757b81 in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,651 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=a5008e8e7077dcb7a211705461185553 as a5008e8e7077dcb7a211705461185553 in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,651 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=0e7c1f9de8c918de0f291881e0de540b as 0e7c1f9de8c918de0f291881e0de540b in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,651 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(585): clone region=34e9215f152c749d1b2855bf5988c248 as 34e9215f152c749d1b2855bf5988c248 in snapshot testWithMapReduceMultiRegion 2023-02-13 00:03:34,653 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 5fd8d083355a03b05437fe4a6ddb21ec, NAME => 'testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,654 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e2f1890c8e2d83f800fa4dfa489f5d90, NAME => 'testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,654 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 5fbc423bd225efe8d3c0c264305faab3, NAME => 'testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,654 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => ced57dbebf889853620545c25b19a141, NAME => 'testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,654 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a5008e8e7077dcb7a211705461185553, NAME => 'testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,655 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e2c1534c85d18491550a0e42706666ed, NAME => 'testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,655 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 80cbbd1557f99d8399d9bef4febabb4d, NAME => 'testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,655 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => a8d913dcb78336766996717a08757b81, NAME => 'testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,684 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,684 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,684 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97a012438e52429e9a040ab0c07f2604 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,685 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 5fbc423bd225efe8d3c0c264305faab3, disabling compactions & flushes 2023-02-13 00:03:34,685 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:34,685 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:34,685 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. after waiting 0 ms 2023-02-13 00:03:34,685 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:34,685 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:34,685 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 5fbc423bd225efe8d3c0c264305faab3: Waiting for close lock at 1676246614685Disabling compacts and flushes for region at 1676246614685Disabling writes for close at 1676246614685Writing region close event to WAL at 1676246614685Closed at 1676246614685 2023-02-13 00:03:34,685 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 0e7c1f9de8c918de0f291881e0de540b, NAME => 'testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,694 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dbdeca7b6c6248c3ac9d995fcbaad566 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,696 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,696 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 043508614db845fc860f41e2af08ec54 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,697 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,697 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3f326e43a794dafaad4be0bba77b74d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,702 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,702 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a5f25828c294cf6a2a2180ecc7c0fef from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,708 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 5fd8d083355a03b05437fe4a6ddb21ec, disabling compactions & flushes 2023-02-13 00:03:34,709 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:34,709 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:34,709 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. after waiting 0 ms 2023-02-13 00:03:34,709 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:34,709 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:34,709 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 5fd8d083355a03b05437fe4a6ddb21ec: Waiting for close lock at 1676246614708Disabling compacts and flushes for region at 1676246614708Disabling writes for close at 1676246614709 (+1 ms)Writing region close event to WAL at 1676246614709Closed at 1676246614709 2023-02-13 00:03:34,709 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 34e9215f152c749d1b2855bf5988c248, NAME => 'testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,720 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing ced57dbebf889853620545c25b19a141, disabling compactions & flushes 2023-02-13 00:03:34,720 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:34,720 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:34,720 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. after waiting 0 ms 2023-02-13 00:03:34,720 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:34,720 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f6bbec372354358b8fbe50ef0f2ce36 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,720 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:34,720 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,720 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for ced57dbebf889853620545c25b19a141: Waiting for close lock at 1676246614720Disabling compacts and flushes for region at 1676246614720Disabling writes for close at 1676246614720Writing region close event to WAL at 1676246614720Closed at 1676246614720 2023-02-13 00:03:34,720 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 48ec01783eee49389e79a9597fe27783 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,721 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,721 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a6abdb3fb1d44a298d17ad16e54593b3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,721 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 350e1dc8e8734097b6e1917c1a6fed64 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,722 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d5d793de80a748fc9e61e49b9030d974 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,732 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,733 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20be9a6dfd214157b1f305840770a217 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,735 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 23e80fc8c3f844da928a0b1072e5e6bf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,735 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing a8d913dcb78336766996717a08757b81, disabling compactions & flushes 2023-02-13 00:03:34,735 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:34,735 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:34,735 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. after waiting 0 ms 2023-02-13 00:03:34,735 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:34,735 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:34,735 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for a8d913dcb78336766996717a08757b81: Waiting for close lock at 1676246614735Disabling compacts and flushes for region at 1676246614735Disabling writes for close at 1676246614735Writing region close event to WAL at 1676246614735Closed at 1676246614735 2023-02-13 00:03:34,735 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e2c1534c85d18491550a0e42706666ed, disabling compactions & flushes 2023-02-13 00:03:34,736 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 80cbbd1557f99d8399d9bef4febabb4d, disabling compactions & flushes 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:34,736 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. after waiting 0 ms 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:34,736 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. after waiting 0 ms 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e2c1534c85d18491550a0e42706666ed: Waiting for close lock at 1676246614735Disabling compacts and flushes for region at 1676246614735Disabling writes for close at 1676246614736 (+1 ms)Writing region close event to WAL at 1676246614736Closed at 1676246614736 2023-02-13 00:03:34,736 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:34,736 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 80cbbd1557f99d8399d9bef4febabb4d: Waiting for close lock at 1676246614736Disabling compacts and flushes for region at 1676246614736Disabling writes for close at 1676246614736Writing region close event to WAL at 1676246614736Closed at 1676246614736 2023-02-13 00:03:34,744 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a715872ef0a34510931d424c7f09ba3d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,744 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:34,744 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 89a26f51c0af481ebe961fb5d5c33d79 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,745 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4d4ad6e919c241b68af90d7723ce8734 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,745 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a5008e8e7077dcb7a211705461185553, disabling compactions & flushes 2023-02-13 00:03:34,745 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:34,745 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:34,745 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. after waiting 0 ms 2023-02-13 00:03:34,745 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:34,745 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:34,745 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a5008e8e7077dcb7a211705461185553: Waiting for close lock at 1676246614745Disabling compacts and flushes for region at 1676246614745Disabling writes for close at 1676246614745Writing region close event to WAL at 1676246614745Closed at 1676246614745 2023-02-13 00:03:34,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e2f1890c8e2d83f800fa4dfa489f5d90, disabling compactions & flushes 2023-02-13 00:03:34,747 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7bbaa3b7498d40fd8a7c4866fc72f852 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 00:03:34,747 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:34,747 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 0e7c1f9de8c918de0f291881e0de540b, disabling compactions & flushes 2023-02-13 00:03:34,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:34,748 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. after waiting 0 ms 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. after waiting 0 ms 2023-02-13 00:03:34,748 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e2f1890c8e2d83f800fa4dfa489f5d90: Waiting for close lock at 1676246614747Disabling compacts and flushes for region at 1676246614747Disabling writes for close at 1676246614748 (+1 ms)Writing region close event to WAL at 1676246614748Closed at 1676246614748 2023-02-13 00:03:34,748 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:34,748 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 0e7c1f9de8c918de0f291881e0de540b: Waiting for close lock at 1676246614747Disabling compacts and flushes for region at 1676246614747Disabling writes for close at 1676246614748 (+1 ms)Writing region close event to WAL at 1676246614748Closed at 1676246614748 2023-02-13 00:03:34,750 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 34e9215f152c749d1b2855bf5988c248, disabling compactions & flushes 2023-02-13 00:03:34,750 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:34,750 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:34,750 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. after waiting 0 ms 2023-02-13 00:03:34,750 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:34,750 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:34,750 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 34e9215f152c749d1b2855bf5988c248: Waiting for close lock at 1676246614750Disabling compacts and flushes for region at 1676246614750Disabling writes for close at 1676246614750Writing region close event to WAL at 1676246614750Closed at 1676246614750 2023-02-13 00:03:34,750 INFO [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676246611299 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:34,750 DEBUG [Listener at localhost/40573] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,751 DEBUG [Listener at localhost/40573] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b 2023-02-13 00:03:34,751 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-data/ 2023-02-13 00:03:34,752 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----default/ 2023-02-13 00:03:34,752 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 00:03:34,753 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------0e7c1f9de8c918de0f291881e0de540b/ 2023-02-13 00:03:34,753 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,753 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,754 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=0e7c1f9de8c918de0f291881e0de540b-20be9a6dfd214157b1f305840770a217 2023-02-13 00:03:34,754 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,754 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=0e7c1f9de8c918de0f291881e0de540b-4d4ad6e919c241b68af90d7723ce8734 2023-02-13 00:03:34,754 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------34e9215f152c749d1b2855bf5988c248/ 2023-02-13 00:03:34,755 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,755 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,755 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=34e9215f152c749d1b2855bf5988c248-89a26f51c0af481ebe961fb5d5c33d79 2023-02-13 00:03:34,755 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,756 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=34e9215f152c749d1b2855bf5988c248-7bbaa3b7498d40fd8a7c4866fc72f852 2023-02-13 00:03:34,756 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------5fbc423bd225efe8d3c0c264305faab3/ 2023-02-13 00:03:34,756 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,757 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------5fd8d083355a03b05437fe4a6ddb21ec/ 2023-02-13 00:03:34,757 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,757 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------80cbbd1557f99d8399d9bef4febabb4d/ 2023-02-13 00:03:34,758 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,758 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,758 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=80cbbd1557f99d8399d9bef4febabb4d-f3f326e43a794dafaad4be0bba77b74d 2023-02-13 00:03:34,758 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,759 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=80cbbd1557f99d8399d9bef4febabb4d-d5d793de80a748fc9e61e49b9030d974 2023-02-13 00:03:34,759 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------a5008e8e7077dcb7a211705461185553/ 2023-02-13 00:03:34,759 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,759 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,760 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=a5008e8e7077dcb7a211705461185553-48ec01783eee49389e79a9597fe27783 2023-02-13 00:03:34,760 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,761 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=a5008e8e7077dcb7a211705461185553-23e80fc8c3f844da928a0b1072e5e6bf 2023-02-13 00:03:34,761 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------a8d913dcb78336766996717a08757b81/ 2023-02-13 00:03:34,761 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,761 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,762 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=a8d913dcb78336766996717a08757b81-9a5f25828c294cf6a2a2180ecc7c0fef 2023-02-13 00:03:34,762 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,762 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=a8d913dcb78336766996717a08757b81-a6abdb3fb1d44a298d17ad16e54593b3 2023-02-13 00:03:34,762 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------ced57dbebf889853620545c25b19a141/ 2023-02-13 00:03:34,763 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,763 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,763 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=ced57dbebf889853620545c25b19a141-97a012438e52429e9a040ab0c07f2604 2023-02-13 00:03:34,763 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,764 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=ced57dbebf889853620545c25b19a141-dbdeca7b6c6248c3ac9d995fcbaad566 2023-02-13 00:03:34,764 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------e2c1534c85d18491550a0e42706666ed/ 2023-02-13 00:03:34,764 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,764 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,765 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=e2c1534c85d18491550a0e42706666ed-043508614db845fc860f41e2af08ec54 2023-02-13 00:03:34,765 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,765 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=e2c1534c85d18491550a0e42706666ed-4f6bbec372354358b8fbe50ef0f2ce36 2023-02-13 00:03:34,766 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |----------e2f1890c8e2d83f800fa4dfa489f5d90/ 2023-02-13 00:03:34,766 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:34,766 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:34,767 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=e2f1890c8e2d83f800fa4dfa489f5d90-350e1dc8e8734097b6e1917c1a6fed64 2023-02-13 00:03:34,767 DEBUG [Listener at localhost/40573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:34,767 DEBUG [Listener at localhost/40573] util.CommonFSUtils(702): |----------------testWithMapReduce=e2f1890c8e2d83f800fa4dfa489f5d90-a715872ef0a34510931d424c7f09ba3d 2023-02-13 00:03:34,775 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,775 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,775 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,776 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,776 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,777 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,777 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,845 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop-5328733694467002044.jar 2023-02-13 00:03:34,845 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,846 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,846 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,847 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,847 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,847 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,848 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 00:03:34,848 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 00:03:34,849 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 00:03:34,849 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 00:03:34,850 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 00:03:34,850 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 00:03:34,851 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 00:03:34,851 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 00:03:34,851 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 00:03:34,852 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 00:03:34,857 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:34,858 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:03:34,858 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:03:34,859 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:03:34,859 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 00:03:34,927 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop-4344847122444453986.jar 2023-02-13 00:03:34,927 DEBUG [Listener at localhost/40573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 00:03:34,975 WARN [Listener at localhost/40573] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 00:03:35,024 INFO [Listener at localhost/40573] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 00:03:35,404 WARN [Listener at localhost/40573] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/mapreduce.cluster.local.dir/1676246615332/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 00:03:35,405 WARN [Listener at localhost/40573] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/mapreduce.cluster.local.dir/1676246615332/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 00:03:35,578 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:35,578 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:35,580 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:35,582 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:35,583 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1 2023-02-13 00:03:35,584 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e7c1f9de8c918de0f291881e0de540b columnFamilyName f1 2023-02-13 00:03:35,592 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/testWithMapReduce=0e7c1f9de8c918de0f291881e0de540b-20be9a6dfd214157b1f305840770a217 2023-02-13 00:03:35,593 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(310): Store=0e7c1f9de8c918de0f291881e0de540b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,593 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:35,594 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2 2023-02-13 00:03:35,595 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e7c1f9de8c918de0f291881e0de540b columnFamilyName f2 2023-02-13 00:03:35,609 DEBUG [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/testWithMapReduce=0e7c1f9de8c918de0f291881e0de540b-4d4ad6e919c241b68af90d7723ce8734 2023-02-13 00:03:35,609 INFO [StoreOpener-0e7c1f9de8c918de0f291881e0de540b-1] regionserver.HStore(310): Store=0e7c1f9de8c918de0f291881e0de540b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,609 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:35,610 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0e7c1f9de8c918de0f291881e0de540b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72736386, jitterRate=0.08385661244392395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:35,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0e7c1f9de8c918de0f291881e0de540b: Writing region info on filesystem at 1676246615580Initializing all the Stores at 1676246615581 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615581Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615581Region opened successfully at 1676246615610 (+29 ms) 2023-02-13 00:03:35,614 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:03:35,614 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 00:03:35,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0e7c1f9de8c918de0f291881e0de540b, disabling compactions & flushes 2023-02-13 00:03:35,797 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:35,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:35,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. after waiting 0 ms 2023-02-13 00:03:35,797 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:35,802 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:35,802 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0e7c1f9de8c918de0f291881e0de540b: Waiting for close lock at 1676246615797Disabling compacts and flushes for region at 1676246615797Disabling writes for close at 1676246615797Writing region close event to WAL at 1676246615802 (+5 ms)Closed at 1676246615802 2023-02-13 00:03:35,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:35,818 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:35,819 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:35,821 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:35,823 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1 2023-02-13 00:03:35,823 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e9215f152c749d1b2855bf5988c248 columnFamilyName f1 2023-02-13 00:03:35,831 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/testWithMapReduce=34e9215f152c749d1b2855bf5988c248-89a26f51c0af481ebe961fb5d5c33d79 2023-02-13 00:03:35,831 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(310): Store=34e9215f152c749d1b2855bf5988c248/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,831 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:35,832 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2 2023-02-13 00:03:35,833 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e9215f152c749d1b2855bf5988c248 columnFamilyName f2 2023-02-13 00:03:35,841 DEBUG [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/testWithMapReduce=34e9215f152c749d1b2855bf5988c248-7bbaa3b7498d40fd8a7c4866fc72f852 2023-02-13 00:03:35,841 INFO [StoreOpener-34e9215f152c749d1b2855bf5988c248-1] regionserver.HStore(310): Store=34e9215f152c749d1b2855bf5988c248/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:35,842 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 34e9215f152c749d1b2855bf5988c248; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59234231, jitterRate=-0.11734117567539215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:35,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 34e9215f152c749d1b2855bf5988c248: Writing region info on filesystem at 1676246615819Initializing all the Stores at 1676246615820 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615821 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615821Region opened successfully at 1676246615842 (+21 ms) 2023-02-13 00:03:35,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 34e9215f152c749d1b2855bf5988c248, disabling compactions & flushes 2023-02-13 00:03:35,889 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:35,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:35,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. after waiting 0 ms 2023-02-13 00:03:35,889 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:35,892 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:35,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 34e9215f152c749d1b2855bf5988c248: Waiting for close lock at 1676246615889Disabling compacts and flushes for region at 1676246615889Disabling writes for close at 1676246615889Writing region close event to WAL at 1676246615892 (+3 ms)Closed at 1676246615892 2023-02-13 00:03:35,898 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:35,898 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:35,899 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:35,902 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:35,904 DEBUG [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f1 2023-02-13 00:03:35,904 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbc423bd225efe8d3c0c264305faab3 columnFamilyName f1 2023-02-13 00:03:35,905 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(310): Store=5fbc423bd225efe8d3c0c264305faab3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,905 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:35,907 DEBUG [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f2 2023-02-13 00:03:35,907 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbc423bd225efe8d3c0c264305faab3 columnFamilyName f2 2023-02-13 00:03:35,908 INFO [StoreOpener-5fbc423bd225efe8d3c0c264305faab3-1] regionserver.HStore(310): Store=5fbc423bd225efe8d3c0c264305faab3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,908 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:35,908 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5fbc423bd225efe8d3c0c264305faab3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62146901, jitterRate=-0.0739390105009079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:35,908 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5fbc423bd225efe8d3c0c264305faab3: Writing region info on filesystem at 1676246615900Initializing all the Stores at 1676246615901 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615901Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615901Region opened successfully at 1676246615908 (+7 ms) 2023-02-13 00:03:35,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5fbc423bd225efe8d3c0c264305faab3, disabling compactions & flushes 2023-02-13 00:03:35,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:35,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:35,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. after waiting 0 ms 2023-02-13 00:03:35,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:35,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:35,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5fbc423bd225efe8d3c0c264305faab3: Waiting for close lock at 1676246615927Disabling compacts and flushes for region at 1676246615927Disabling writes for close at 1676246615927Writing region close event to WAL at 1676246615927Closed at 1676246615927 2023-02-13 00:03:35,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:35,934 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:35,948 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:35,955 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ced57dbebf889853620545c25b19a141 2023-02-13 00:03:35,957 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1 2023-02-13 00:03:35,957 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ced57dbebf889853620545c25b19a141 columnFamilyName f1 2023-02-13 00:03:35,965 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/testWithMapReduce=ced57dbebf889853620545c25b19a141-97a012438e52429e9a040ab0c07f2604 2023-02-13 00:03:35,965 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(310): Store=ced57dbebf889853620545c25b19a141/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,966 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ced57dbebf889853620545c25b19a141 2023-02-13 00:03:35,967 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2 2023-02-13 00:03:35,967 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ced57dbebf889853620545c25b19a141 columnFamilyName f2 2023-02-13 00:03:35,978 DEBUG [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/testWithMapReduce=ced57dbebf889853620545c25b19a141-dbdeca7b6c6248c3ac9d995fcbaad566 2023-02-13 00:03:35,978 INFO [StoreOpener-ced57dbebf889853620545c25b19a141-1] regionserver.HStore(310): Store=ced57dbebf889853620545c25b19a141/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:35,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:35,978 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ced57dbebf889853620545c25b19a141; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65871738, jitterRate=-0.018434613943099976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:35,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ced57dbebf889853620545c25b19a141: Writing region info on filesystem at 1676246615949Initializing all the Stores at 1676246615951 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615951Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246615951Region opened successfully at 1676246615978 (+27 ms) 2023-02-13 00:03:36,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ced57dbebf889853620545c25b19a141, disabling compactions & flushes 2023-02-13 00:03:36,030 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:36,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:36,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. after waiting 0 ms 2023-02-13 00:03:36,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:36,033 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:36,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ced57dbebf889853620545c25b19a141: Waiting for close lock at 1676246616030Disabling compacts and flushes for region at 1676246616030Disabling writes for close at 1676246616030Writing region close event to WAL at 1676246616033 (+3 ms)Closed at 1676246616033 2023-02-13 00:03:36,039 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:36,039 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:36,049 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:36,051 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:36,053 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1 2023-02-13 00:03:36,053 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80cbbd1557f99d8399d9bef4febabb4d columnFamilyName f1 2023-02-13 00:03:36,061 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/testWithMapReduce=80cbbd1557f99d8399d9bef4febabb4d-f3f326e43a794dafaad4be0bba77b74d 2023-02-13 00:03:36,061 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(310): Store=80cbbd1557f99d8399d9bef4febabb4d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,061 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:36,062 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2 2023-02-13 00:03:36,063 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80cbbd1557f99d8399d9bef4febabb4d columnFamilyName f2 2023-02-13 00:03:36,070 DEBUG [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/testWithMapReduce=80cbbd1557f99d8399d9bef4febabb4d-d5d793de80a748fc9e61e49b9030d974 2023-02-13 00:03:36,070 INFO [StoreOpener-80cbbd1557f99d8399d9bef4febabb4d-1] regionserver.HStore(310): Store=80cbbd1557f99d8399d9bef4febabb4d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,070 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:36,071 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 80cbbd1557f99d8399d9bef4febabb4d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64759889, jitterRate=-0.0350024551153183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:36,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 80cbbd1557f99d8399d9bef4febabb4d: Writing region info on filesystem at 1676246616049Initializing all the Stores at 1676246616050 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616050Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616050Region opened successfully at 1676246616071 (+21 ms) 2023-02-13 00:03:36,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 80cbbd1557f99d8399d9bef4febabb4d, disabling compactions & flushes 2023-02-13 00:03:36,146 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:36,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:36,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. after waiting 0 ms 2023-02-13 00:03:36,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:36,149 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:36,149 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 80cbbd1557f99d8399d9bef4febabb4d: Waiting for close lock at 1676246616146Disabling compacts and flushes for region at 1676246616146Disabling writes for close at 1676246616146Writing region close event to WAL at 1676246616149 (+3 ms)Closed at 1676246616149 2023-02-13 00:03:36,159 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:36,159 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:36,160 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:36,162 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:36,163 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1 2023-02-13 00:03:36,164 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c1534c85d18491550a0e42706666ed columnFamilyName f1 2023-02-13 00:03:36,170 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/testWithMapReduce=e2c1534c85d18491550a0e42706666ed-043508614db845fc860f41e2af08ec54 2023-02-13 00:03:36,170 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(310): Store=e2c1534c85d18491550a0e42706666ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,171 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:36,172 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2 2023-02-13 00:03:36,172 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c1534c85d18491550a0e42706666ed columnFamilyName f2 2023-02-13 00:03:36,178 DEBUG [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/testWithMapReduce=e2c1534c85d18491550a0e42706666ed-4f6bbec372354358b8fbe50ef0f2ce36 2023-02-13 00:03:36,179 INFO [StoreOpener-e2c1534c85d18491550a0e42706666ed-1] regionserver.HStore(310): Store=e2c1534c85d18491550a0e42706666ed/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,179 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:36,179 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e2c1534c85d18491550a0e42706666ed; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65736811, jitterRate=-0.02044518291950226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:36,179 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e2c1534c85d18491550a0e42706666ed: Writing region info on filesystem at 1676246616160Initializing all the Stores at 1676246616161 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616161Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616161Region opened successfully at 1676246616179 (+18 ms) 2023-02-13 00:03:36,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e2c1534c85d18491550a0e42706666ed, disabling compactions & flushes 2023-02-13 00:03:36,215 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:36,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:36,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. after waiting 0 ms 2023-02-13 00:03:36,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:36,220 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:36,220 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e2c1534c85d18491550a0e42706666ed: Waiting for close lock at 1676246616215Disabling compacts and flushes for region at 1676246616215Disabling writes for close at 1676246616215Writing region close event to WAL at 1676246616220 (+5 ms)Closed at 1676246616220 2023-02-13 00:03:36,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:36,225 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:36,227 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:36,229 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a8d913dcb78336766996717a08757b81 2023-02-13 00:03:36,230 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1 2023-02-13 00:03:36,230 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8d913dcb78336766996717a08757b81 columnFamilyName f1 2023-02-13 00:03:36,238 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/testWithMapReduce=a8d913dcb78336766996717a08757b81-9a5f25828c294cf6a2a2180ecc7c0fef 2023-02-13 00:03:36,238 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(310): Store=a8d913dcb78336766996717a08757b81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,238 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a8d913dcb78336766996717a08757b81 2023-02-13 00:03:36,239 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2 2023-02-13 00:03:36,239 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8d913dcb78336766996717a08757b81 columnFamilyName f2 2023-02-13 00:03:36,247 DEBUG [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/testWithMapReduce=a8d913dcb78336766996717a08757b81-a6abdb3fb1d44a298d17ad16e54593b3 2023-02-13 00:03:36,247 INFO [StoreOpener-a8d913dcb78336766996717a08757b81-1] regionserver.HStore(310): Store=a8d913dcb78336766996717a08757b81/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:36,247 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a8d913dcb78336766996717a08757b81; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74360785, jitterRate=0.10806204378604889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:36,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a8d913dcb78336766996717a08757b81: Writing region info on filesystem at 1676246616227Initializing all the Stores at 1676246616228 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616228Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616228Region opened successfully at 1676246616248 (+20 ms) 2023-02-13 00:03:36,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a8d913dcb78336766996717a08757b81, disabling compactions & flushes 2023-02-13 00:03:36,283 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:36,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:36,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. after waiting 0 ms 2023-02-13 00:03:36,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:36,289 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:36,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a8d913dcb78336766996717a08757b81: Waiting for close lock at 1676246616283Disabling compacts and flushes for region at 1676246616283Disabling writes for close at 1676246616284 (+1 ms)Writing region close event to WAL at 1676246616289 (+5 ms)Closed at 1676246616289 2023-02-13 00:03:36,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:36,296 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:36,301 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:36,303 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:36,304 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1 2023-02-13 00:03:36,304 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2f1890c8e2d83f800fa4dfa489f5d90 columnFamilyName f1 2023-02-13 00:03:36,310 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/testWithMapReduce=e2f1890c8e2d83f800fa4dfa489f5d90-350e1dc8e8734097b6e1917c1a6fed64 2023-02-13 00:03:36,310 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(310): Store=e2f1890c8e2d83f800fa4dfa489f5d90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,310 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:36,311 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2 2023-02-13 00:03:36,312 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2f1890c8e2d83f800fa4dfa489f5d90 columnFamilyName f2 2023-02-13 00:03:36,317 DEBUG [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/testWithMapReduce=e2f1890c8e2d83f800fa4dfa489f5d90-a715872ef0a34510931d424c7f09ba3d 2023-02-13 00:03:36,317 INFO [StoreOpener-e2f1890c8e2d83f800fa4dfa489f5d90-1] regionserver.HStore(310): Store=e2f1890c8e2d83f800fa4dfa489f5d90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,317 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:36,318 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e2f1890c8e2d83f800fa4dfa489f5d90; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63726007, jitterRate=-0.0504084974527359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:36,318 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e2f1890c8e2d83f800fa4dfa489f5d90: Writing region info on filesystem at 1676246616301Initializing all the Stores at 1676246616302 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616302Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616302Region opened successfully at 1676246616318 (+16 ms) 2023-02-13 00:03:36,349 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e2f1890c8e2d83f800fa4dfa489f5d90, disabling compactions & flushes 2023-02-13 00:03:36,350 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:36,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:36,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. after waiting 0 ms 2023-02-13 00:03:36,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:36,352 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:36,352 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e2f1890c8e2d83f800fa4dfa489f5d90: Waiting for close lock at 1676246616349Disabling compacts and flushes for region at 1676246616349Disabling writes for close at 1676246616350 (+1 ms)Writing region close event to WAL at 1676246616352 (+2 ms)Closed at 1676246616352 2023-02-13 00:03:36,357 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:36,357 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:36,358 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:36,360 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:36,361 DEBUG [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f1 2023-02-13 00:03:36,361 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fd8d083355a03b05437fe4a6ddb21ec columnFamilyName f1 2023-02-13 00:03:36,362 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(310): Store=5fd8d083355a03b05437fe4a6ddb21ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,362 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:36,363 DEBUG [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f2 2023-02-13 00:03:36,364 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fd8d083355a03b05437fe4a6ddb21ec columnFamilyName f2 2023-02-13 00:03:36,364 INFO [StoreOpener-5fd8d083355a03b05437fe4a6ddb21ec-1] regionserver.HStore(310): Store=5fd8d083355a03b05437fe4a6ddb21ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,364 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:36,364 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5fd8d083355a03b05437fe4a6ddb21ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62712231, jitterRate=-0.06551493704319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:36,364 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5fd8d083355a03b05437fe4a6ddb21ec: Writing region info on filesystem at 1676246616358Initializing all the Stores at 1676246616359 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616359Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616359Region opened successfully at 1676246616364 (+5 ms) 2023-02-13 00:03:36,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5fd8d083355a03b05437fe4a6ddb21ec, disabling compactions & flushes 2023-02-13 00:03:36,398 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:36,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:36,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. after waiting 0 ms 2023-02-13 00:03:36,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:36,398 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:36,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5fd8d083355a03b05437fe4a6ddb21ec: Waiting for close lock at 1676246616398Disabling compacts and flushes for region at 1676246616398Disabling writes for close at 1676246616398Writing region close event to WAL at 1676246616398Closed at 1676246616398 2023-02-13 00:03:36,401 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:36,402 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:36,404 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:36,407 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:36,407 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1 2023-02-13 00:03:36,408 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5008e8e7077dcb7a211705461185553 columnFamilyName f1 2023-02-13 00:03:36,413 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/testWithMapReduce=a5008e8e7077dcb7a211705461185553-48ec01783eee49389e79a9597fe27783 2023-02-13 00:03:36,413 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(310): Store=a5008e8e7077dcb7a211705461185553/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,414 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:36,414 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2 2023-02-13 00:03:36,415 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5008e8e7077dcb7a211705461185553 columnFamilyName f2 2023-02-13 00:03:36,420 DEBUG [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(539): loaded hdfs://localhost:42801/user/jenkins/test-data/85482bd2-da72-5194-9864-eab8cf43fee1/testWithMapReduceMultiRegion/8bf1ea43-011d-4789-b0dc-57a143fe9e3b/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/testWithMapReduce=a5008e8e7077dcb7a211705461185553-23e80fc8c3f844da928a0b1072e5e6bf 2023-02-13 00:03:36,420 INFO [StoreOpener-a5008e8e7077dcb7a211705461185553-1] regionserver.HStore(310): Store=a5008e8e7077dcb7a211705461185553/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:36,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:36,420 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a5008e8e7077dcb7a211705461185553; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64989809, jitterRate=-0.031576380133628845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:36,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a5008e8e7077dcb7a211705461185553: Writing region info on filesystem at 1676246616405Initializing all the Stores at 1676246616406 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616406Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246616406Region opened successfully at 1676246616420 (+14 ms) 2023-02-13 00:03:36,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a5008e8e7077dcb7a211705461185553, disabling compactions & flushes 2023-02-13 00:03:36,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:36,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:36,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. after waiting 0 ms 2023-02-13 00:03:36,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:36,471 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:36,471 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a5008e8e7077dcb7a211705461185553: Waiting for close lock at 1676246616465Disabling compacts and flushes for region at 1676246616465Disabling writes for close at 1676246616466 (+1 ms)Writing region close event to WAL at 1676246616471 (+5 ms)Closed at 1676246616471 2023-02-13 00:03:37,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-13 00:03:37,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-13 00:03:37,529 INFO [Listener at localhost/40573] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 00:03:37,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 00:03:37,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 00:03:37,540 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246617540"}]},"ts":"1676246617540"} 2023-02-13 00:03:37,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:37,542 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 00:03:37,544 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 00:03:37,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, UNASSIGN}] 2023-02-13 00:03:37,550 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, UNASSIGN 2023-02-13 00:03:37,551 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, UNASSIGN 2023-02-13 00:03:37,552 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, UNASSIGN 2023-02-13 00:03:37,552 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, UNASSIGN 2023-02-13 00:03:37,552 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, UNASSIGN 2023-02-13 00:03:37,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5fd8d083355a03b05437fe4a6ddb21ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:37,554 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ced57dbebf889853620545c25b19a141, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:37,554 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=a5008e8e7077dcb7a211705461185553, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:37,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246617554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617554"}]},"ts":"1676246617554"} 2023-02-13 00:03:37,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0e7c1f9de8c918de0f291881e0de540b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:37,555 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617554"}]},"ts":"1676246617554"} 2023-02-13 00:03:37,554 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a8d913dcb78336766996717a08757b81, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:37,555 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617554"}]},"ts":"1676246617554"} 2023-02-13 00:03:37,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676246609565.a5008e8e7077dcb7a211705461185553.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617554"}]},"ts":"1676246617554"} 2023-02-13 00:03:37,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617554"}]},"ts":"1676246617554"} 2023-02-13 00:03:37,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 5fd8d083355a03b05437fe4a6ddb21ec, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:37,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=42, state=RUNNABLE; CloseRegionProcedure ced57dbebf889853620545c25b19a141, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:37,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure 0e7c1f9de8c918de0f291881e0de540b, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:37,565 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, UNASSIGN 2023-02-13 00:03:37,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure a5008e8e7077dcb7a211705461185553, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:37,580 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e2f1890c8e2d83f800fa4dfa489f5d90, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:37,580 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617580"}]},"ts":"1676246617580"} 2023-02-13 00:03:37,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=41, state=RUNNABLE; CloseRegionProcedure a8d913dcb78336766996717a08757b81, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:37,581 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, UNASSIGN 2023-02-13 00:03:37,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=34e9215f152c749d1b2855bf5988c248, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:37,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617591"}]},"ts":"1676246617591"} 2023-02-13 00:03:37,592 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, UNASSIGN 2023-02-13 00:03:37,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure e2f1890c8e2d83f800fa4dfa489f5d90, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:37,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 34e9215f152c749d1b2855bf5988c248, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:37,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e2c1534c85d18491550a0e42706666ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:37,595 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617594"}]},"ts":"1676246617594"} 2023-02-13 00:03:37,595 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, UNASSIGN 2023-02-13 00:03:37,596 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=80cbbd1557f99d8399d9bef4febabb4d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:37,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617596"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617596"}]},"ts":"1676246617596"} 2023-02-13 00:03:37,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure e2c1534c85d18491550a0e42706666ed, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:37,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 80cbbd1557f99d8399d9bef4febabb4d, server=jenkins-hbase4.apache.org,42817,1676246606714}] 2023-02-13 00:03:37,600 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, UNASSIGN 2023-02-13 00:03:37,602 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=5fbc423bd225efe8d3c0c264305faab3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:37,602 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246617602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246617602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246617602"}]},"ts":"1676246617602"} 2023-02-13 00:03:37,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 5fbc423bd225efe8d3c0c264305faab3, server=jenkins-hbase4.apache.org,38931,1676246606668}] 2023-02-13 00:03:37,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:37,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a5008e8e7077dcb7a211705461185553, disabling compactions & flushes 2023-02-13 00:03:37,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. after waiting 0 ms 2023-02-13 00:03:37,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:37,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:37,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 80cbbd1557f99d8399d9bef4febabb4d, disabling compactions & flushes 2023-02-13 00:03:37,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:37,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:37,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. after waiting 0 ms 2023-02-13 00:03:37,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:37,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d. 2023-02-13 00:03:37,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 80cbbd1557f99d8399d9bef4febabb4d: Waiting for close lock at 1676246617724Running coprocessor pre-close hooks at 1676246617724Disabling compacts and flushes for region at 1676246617724Disabling writes for close at 1676246617725 (+1 ms)Writing region close event to WAL at 1676246617736 (+11 ms)Running coprocessor post-close hooks at 1676246617741 (+5 ms)Closed at 1676246617742 (+1 ms) 2023-02-13 00:03:37,745 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=80cbbd1557f99d8399d9bef4febabb4d, regionState=CLOSED 2023-02-13 00:03:37,745 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617745"}]},"ts":"1676246617745"} 2023-02-13 00:03:37,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:37,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a8d913dcb78336766996717a08757b81 2023-02-13 00:03:37,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a8d913dcb78336766996717a08757b81, disabling compactions & flushes 2023-02-13 00:03:37,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:37,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:37,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. after waiting 0 ms 2023-02-13 00:03:37,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:37,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-13 00:03:37,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 80cbbd1557f99d8399d9bef4febabb4d, server=jenkins-hbase4.apache.org,42817,1676246606714 in 150 msec 2023-02-13 00:03:37,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=80cbbd1557f99d8399d9bef4febabb4d, UNASSIGN in 204 msec 2023-02-13 00:03:37,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553. 2023-02-13 00:03:37,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a5008e8e7077dcb7a211705461185553: Waiting for close lock at 1676246617718Running coprocessor pre-close hooks at 1676246617718Disabling compacts and flushes for region at 1676246617718Disabling writes for close at 1676246617718Writing region close event to WAL at 1676246617735 (+17 ms)Running coprocessor post-close hooks at 1676246617764 (+29 ms)Closed at 1676246617764 2023-02-13 00:03:37,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:37,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0e7c1f9de8c918de0f291881e0de540b, disabling compactions & flushes 2023-02-13 00:03:37,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. after waiting 0 ms 2023-02-13 00:03:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:37,768 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=a5008e8e7077dcb7a211705461185553, regionState=CLOSED 2023-02-13 00:03:37,768 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676246609565.a5008e8e7077dcb7a211705461185553.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617768"}]},"ts":"1676246617768"} 2023-02-13 00:03:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81. 2023-02-13 00:03:37,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a8d913dcb78336766996717a08757b81: Waiting for close lock at 1676246617746Running coprocessor pre-close hooks at 1676246617746Disabling compacts and flushes for region at 1676246617746Disabling writes for close at 1676246617746Writing region close event to WAL at 1676246617763 (+17 ms)Running coprocessor post-close hooks at 1676246617774 (+11 ms)Closed at 1676246617775 (+1 ms) 2023-02-13 00:03:37,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-13 00:03:37,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure a5008e8e7077dcb7a211705461185553, server=jenkins-hbase4.apache.org,38931,1676246606668 in 205 msec 2023-02-13 00:03:37,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a8d913dcb78336766996717a08757b81 2023-02-13 00:03:37,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:37,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2f1890c8e2d83f800fa4dfa489f5d90, disabling compactions & flushes 2023-02-13 00:03:37,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:37,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:37,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. after waiting 0 ms 2023-02-13 00:03:37,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:37,777 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a8d913dcb78336766996717a08757b81, regionState=CLOSED 2023-02-13 00:03:37,778 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617777"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617777"}]},"ts":"1676246617777"} 2023-02-13 00:03:37,779 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a5008e8e7077dcb7a211705461185553, UNASSIGN in 230 msec 2023-02-13 00:03:37,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=41 2023-02-13 00:03:37,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=41, state=SUCCESS; CloseRegionProcedure a8d913dcb78336766996717a08757b81, server=jenkins-hbase4.apache.org,42817,1676246606714 in 202 msec 2023-02-13 00:03:37,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a8d913dcb78336766996717a08757b81, UNASSIGN in 239 msec 2023-02-13 00:03:37,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b. 2023-02-13 00:03:37,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0e7c1f9de8c918de0f291881e0de540b: Waiting for close lock at 1676246617767Running coprocessor pre-close hooks at 1676246617767Disabling compacts and flushes for region at 1676246617767Disabling writes for close at 1676246617767Writing region close event to WAL at 1676246617780 (+13 ms)Running coprocessor post-close hooks at 1676246617787 (+7 ms)Closed at 1676246617788 (+1 ms) 2023-02-13 00:03:37,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90. 2023-02-13 00:03:37,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2f1890c8e2d83f800fa4dfa489f5d90: Waiting for close lock at 1676246617777Running coprocessor pre-close hooks at 1676246617777Disabling compacts and flushes for region at 1676246617777Disabling writes for close at 1676246617777Writing region close event to WAL at 1676246617783 (+6 ms)Running coprocessor post-close hooks at 1676246617788 (+5 ms)Closed at 1676246617789 (+1 ms) 2023-02-13 00:03:37,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:37,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:37,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5fbc423bd225efe8d3c0c264305faab3, disabling compactions & flushes 2023-02-13 00:03:37,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:37,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:37,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. after waiting 0 ms 2023-02-13 00:03:37,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:37,792 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0e7c1f9de8c918de0f291881e0de540b, regionState=CLOSED 2023-02-13 00:03:37,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:37,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:37,792 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617792"}]},"ts":"1676246617792"} 2023-02-13 00:03:37,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34e9215f152c749d1b2855bf5988c248, disabling compactions & flushes 2023-02-13 00:03:37,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:37,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:37,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. after waiting 0 ms 2023-02-13 00:03:37,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:37,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e2f1890c8e2d83f800fa4dfa489f5d90, regionState=CLOSED 2023-02-13 00:03:37,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617792"}]},"ts":"1676246617792"} 2023-02-13 00:03:37,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-13 00:03:37,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure 0e7c1f9de8c918de0f291881e0de540b, server=jenkins-hbase4.apache.org,38931,1676246606668 in 230 msec 2023-02-13 00:03:37,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-13 00:03:37,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure e2f1890c8e2d83f800fa4dfa489f5d90, server=jenkins-hbase4.apache.org,42817,1676246606714 in 202 msec 2023-02-13 00:03:37,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0e7c1f9de8c918de0f291881e0de540b, UNASSIGN in 251 msec 2023-02-13 00:03:37,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2f1890c8e2d83f800fa4dfa489f5d90, UNASSIGN in 252 msec 2023-02-13 00:03:37,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 00:03:37,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3. 2023-02-13 00:03:37,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5fbc423bd225efe8d3c0c264305faab3: Waiting for close lock at 1676246617791Running coprocessor pre-close hooks at 1676246617791Disabling compacts and flushes for region at 1676246617791Disabling writes for close at 1676246617791Writing region close event to WAL at 1676246617792 (+1 ms)Running coprocessor post-close hooks at 1676246617811 (+19 ms)Closed at 1676246617821 (+10 ms) 2023-02-13 00:03:37,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248. 2023-02-13 00:03:37,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34e9215f152c749d1b2855bf5988c248: Waiting for close lock at 1676246617792Running coprocessor pre-close hooks at 1676246617792Disabling compacts and flushes for region at 1676246617792Disabling writes for close at 1676246617792Writing region close event to WAL at 1676246617806 (+14 ms)Running coprocessor post-close hooks at 1676246617822 (+16 ms)Closed at 1676246617823 (+1 ms) 2023-02-13 00:03:37,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=5fbc423bd225efe8d3c0c264305faab3, regionState=CLOSED 2023-02-13 00:03:37,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246617824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617824"}]},"ts":"1676246617824"} 2023-02-13 00:03:37,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:37,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:37,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5fd8d083355a03b05437fe4a6ddb21ec, disabling compactions & flushes 2023-02-13 00:03:37,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:37,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:37,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. after waiting 0 ms 2023-02-13 00:03:37,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:37,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:37,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ced57dbebf889853620545c25b19a141 2023-02-13 00:03:37,826 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=34e9215f152c749d1b2855bf5988c248, regionState=CLOSED 2023-02-13 00:03:37,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ced57dbebf889853620545c25b19a141, disabling compactions & flushes 2023-02-13 00:03:37,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:37,826 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617826"}]},"ts":"1676246617826"} 2023-02-13 00:03:37,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:37,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. after waiting 0 ms 2023-02-13 00:03:37,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:37,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-13 00:03:37,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 5fbc423bd225efe8d3c0c264305faab3, server=jenkins-hbase4.apache.org,38931,1676246606668 in 223 msec 2023-02-13 00:03:37,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 00:03:37,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec. 2023-02-13 00:03:37,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5fd8d083355a03b05437fe4a6ddb21ec: Waiting for close lock at 1676246617825Running coprocessor pre-close hooks at 1676246617825Disabling compacts and flushes for region at 1676246617825Disabling writes for close at 1676246617825Writing region close event to WAL at 1676246617826 (+1 ms)Running coprocessor post-close hooks at 1676246617831 (+5 ms)Closed at 1676246617832 (+1 ms) 2023-02-13 00:03:37,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-13 00:03:37,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 34e9215f152c749d1b2855bf5988c248, server=jenkins-hbase4.apache.org,42817,1676246606714 in 235 msec 2023-02-13 00:03:37,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5fbc423bd225efe8d3c0c264305faab3, UNASSIGN in 284 msec 2023-02-13 00:03:37,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:37,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34e9215f152c749d1b2855bf5988c248, UNASSIGN in 286 msec 2023-02-13 00:03:37,835 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5fd8d083355a03b05437fe4a6ddb21ec, regionState=CLOSED 2023-02-13 00:03:37,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246617835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617835"}]},"ts":"1676246617835"} 2023-02-13 00:03:37,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141. 2023-02-13 00:03:37,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ced57dbebf889853620545c25b19a141: Waiting for close lock at 1676246617826Running coprocessor pre-close hooks at 1676246617826Disabling compacts and flushes for region at 1676246617826Disabling writes for close at 1676246617826Writing region close event to WAL at 1676246617829 (+3 ms)Running coprocessor post-close hooks at 1676246617835 (+6 ms)Closed at 1676246617840 (+5 ms) 2023-02-13 00:03:37,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ced57dbebf889853620545c25b19a141 2023-02-13 00:03:37,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:37,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2c1534c85d18491550a0e42706666ed, disabling compactions & flushes 2023-02-13 00:03:37,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:37,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:37,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. after waiting 0 ms 2023-02-13 00:03:37,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:37,843 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ced57dbebf889853620545c25b19a141, regionState=CLOSED 2023-02-13 00:03:37,843 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617843"}]},"ts":"1676246617843"} 2023-02-13 00:03:37,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-13 00:03:37,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 5fd8d083355a03b05437fe4a6ddb21ec, server=jenkins-hbase4.apache.org,42817,1676246606714 in 285 msec 2023-02-13 00:03:37,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:37,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5fd8d083355a03b05437fe4a6ddb21ec, UNASSIGN in 297 msec 2023-02-13 00:03:37,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=42 2023-02-13 00:03:37,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=42, state=SUCCESS; CloseRegionProcedure ced57dbebf889853620545c25b19a141, server=jenkins-hbase4.apache.org,38931,1676246606668 in 284 msec 2023-02-13 00:03:37,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ced57dbebf889853620545c25b19a141, UNASSIGN in 301 msec 2023-02-13 00:03:37,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:37,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed. 2023-02-13 00:03:37,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2c1534c85d18491550a0e42706666ed: Waiting for close lock at 1676246617843Running coprocessor pre-close hooks at 1676246617843Disabling compacts and flushes for region at 1676246617843Disabling writes for close at 1676246617843Writing region close event to WAL at 1676246617862 (+19 ms)Running coprocessor post-close hooks at 1676246617866 (+4 ms)Closed at 1676246617867 (+1 ms) 2023-02-13 00:03:37,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:37,870 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e2c1534c85d18491550a0e42706666ed, regionState=CLOSED 2023-02-13 00:03:37,870 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246617870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246617870"}]},"ts":"1676246617870"} 2023-02-13 00:03:37,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-13 00:03:37,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure e2c1534c85d18491550a0e42706666ed, server=jenkins-hbase4.apache.org,38931,1676246606668 in 275 msec 2023-02-13 00:03:37,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-13 00:03:37,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2c1534c85d18491550a0e42706666ed, UNASSIGN in 328 msec 2023-02-13 00:03:37,877 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246617877"}]},"ts":"1676246617877"} 2023-02-13 00:03:37,879 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 00:03:37,881 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 00:03:37,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 351 msec 2023-02-13 00:03:38,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:38,149 INFO [Listener at localhost/40573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-13 00:03:38,154 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 00:03:38,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:03:38,163 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:03:38,166 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:03:38,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 00:03:38,186 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:38,186 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:38,187 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:38,187 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:38,187 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:38,187 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 2023-02-13 00:03:38,187 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:38,186 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:38,191 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/recovered.edits] 2023-02-13 00:03:38,193 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/recovered.edits] 2023-02-13 00:03:38,195 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/recovered.edits] 2023-02-13 00:03:38,195 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/recovered.edits] 2023-02-13 00:03:38,195 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/recovered.edits] 2023-02-13 00:03:38,197 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/recovered.edits] 2023-02-13 00:03:38,197 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/recovered.edits] 2023-02-13 00:03:38,198 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/recovered.edits] 2023-02-13 00:03:38,211 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/5c3c01c4ed824cb7b73d634144337e4a to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/5c3c01c4ed824cb7b73d634144337e4a 2023-02-13 00:03:38,212 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/923b13ca4102445f9ca284adf9cebacc to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/923b13ca4102445f9ca284adf9cebacc 2023-02-13 00:03:38,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/043508614db845fc860f41e2af08ec54 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/043508614db845fc860f41e2af08ec54 2023-02-13 00:03:38,214 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/89a26f51c0af481ebe961fb5d5c33d79 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/89a26f51c0af481ebe961fb5d5c33d79 2023-02-13 00:03:38,214 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/20be9a6dfd214157b1f305840770a217 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/20be9a6dfd214157b1f305840770a217 2023-02-13 00:03:38,216 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/48ec01783eee49389e79a9597fe27783 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/48ec01783eee49389e79a9597fe27783 2023-02-13 00:03:38,217 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/recovered.edits/6.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3/recovered.edits/6.seqid 2023-02-13 00:03:38,217 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/0cf90efd54d64ad096248de519e002ee to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/0cf90efd54d64ad096248de519e002ee 2023-02-13 00:03:38,218 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/d154c1619b9a4a12bec0c6559f2c9bc6 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f1/d154c1619b9a4a12bec0c6559f2c9bc6 2023-02-13 00:03:38,218 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/f3f326e43a794dafaad4be0bba77b74d to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f1/f3f326e43a794dafaad4be0bba77b74d 2023-02-13 00:03:38,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/9a5f25828c294cf6a2a2180ecc7c0fef to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f1/9a5f25828c294cf6a2a2180ecc7c0fef 2023-02-13 00:03:38,219 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fbc423bd225efe8d3c0c264305faab3 2023-02-13 00:03:38,219 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 2023-02-13 00:03:38,219 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/b22f84cf35e54e92b62b1b20182f62a6 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f1/b22f84cf35e54e92b62b1b20182f62a6 2023-02-13 00:03:38,220 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/ca0d28d75fb44262af08968fc6b0e613 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f1/ca0d28d75fb44262af08968fc6b0e613 2023-02-13 00:03:38,221 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/ab666df376b94970b1997c37fb6365db to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f1/ab666df376b94970b1997c37fb6365db 2023-02-13 00:03:38,222 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/350e1dc8e8734097b6e1917c1a6fed64 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f1/350e1dc8e8734097b6e1917c1a6fed64 2023-02-13 00:03:38,224 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/recovered.edits] 2023-02-13 00:03:38,228 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/4f6bbec372354358b8fbe50ef0f2ce36 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/4f6bbec372354358b8fbe50ef0f2ce36 2023-02-13 00:03:38,229 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/4d4ad6e919c241b68af90d7723ce8734 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/4d4ad6e919c241b68af90d7723ce8734 2023-02-13 00:03:38,230 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/5cfba2e6400245d9a6610e4faebcdf1d to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/5cfba2e6400245d9a6610e4faebcdf1d 2023-02-13 00:03:38,230 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/a6abdb3fb1d44a298d17ad16e54593b3 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/a6abdb3fb1d44a298d17ad16e54593b3 2023-02-13 00:03:38,231 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/7bbaa3b7498d40fd8a7c4866fc72f852 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/7bbaa3b7498d40fd8a7c4866fc72f852 2023-02-13 00:03:38,231 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a53ede9272ac45bc89294265fc3eb0e9 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a53ede9272ac45bc89294265fc3eb0e9 2023-02-13 00:03:38,231 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/23e80fc8c3f844da928a0b1072e5e6bf to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/23e80fc8c3f844da928a0b1072e5e6bf 2023-02-13 00:03:38,232 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/dbb0eca21b4d40fdb8dcd848827cbca2 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/f2/dbb0eca21b4d40fdb8dcd848827cbca2 2023-02-13 00:03:38,233 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/d09eb24b769049c189477c95fbdeecfe to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/f2/d09eb24b769049c189477c95fbdeecfe 2023-02-13 00:03:38,234 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/d5d793de80a748fc9e61e49b9030d974 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/f2/d5d793de80a748fc9e61e49b9030d974 2023-02-13 00:03:38,235 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/ccb50370d61047cf8a7834e3c32d8dab to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/f2/ccb50370d61047cf8a7834e3c32d8dab 2023-02-13 00:03:38,235 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/8cd84892fec64654abbab3c988a89086 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/f2/8cd84892fec64654abbab3c988a89086 2023-02-13 00:03:38,236 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/6f06feef6cd74b76960f735eab10d53f to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/f2/6f06feef6cd74b76960f735eab10d53f 2023-02-13 00:03:38,236 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a715872ef0a34510931d424c7f09ba3d to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/f2/a715872ef0a34510931d424c7f09ba3d 2023-02-13 00:03:38,236 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/97a012438e52429e9a040ab0c07f2604 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/97a012438e52429e9a040ab0c07f2604 2023-02-13 00:03:38,240 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/9cc3a1461b5c40eb8998ce4f2c9ad300 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f1/9cc3a1461b5c40eb8998ce4f2c9ad300 2023-02-13 00:03:38,241 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed/recovered.edits/12.seqid 2023-02-13 00:03:38,242 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2c1534c85d18491550a0e42706666ed 2023-02-13 00:03:38,243 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:38,243 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d/recovered.edits/12.seqid 2023-02-13 00:03:38,244 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553/recovered.edits/12.seqid 2023-02-13 00:03:38,244 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b/recovered.edits/12.seqid 2023-02-13 00:03:38,244 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248/recovered.edits/12.seqid 2023-02-13 00:03:38,244 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/80cbbd1557f99d8399d9bef4febabb4d 2023-02-13 00:03:38,245 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81/recovered.edits/12.seqid 2023-02-13 00:03:38,245 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90/recovered.edits/12.seqid 2023-02-13 00:03:38,246 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/34e9215f152c749d1b2855bf5988c248 2023-02-13 00:03:38,246 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/0e7c1f9de8c918de0f291881e0de540b 2023-02-13 00:03:38,246 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a5008e8e7077dcb7a211705461185553 2023-02-13 00:03:38,247 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/e2f1890c8e2d83f800fa4dfa489f5d90 2023-02-13 00:03:38,247 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/a8d913dcb78336766996717a08757b81 2023-02-13 00:03:38,248 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f1, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/f2, FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/recovered.edits] 2023-02-13 00:03:38,249 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/a2cfe19cb5d94852b252f6d32d8bcf62 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/a2cfe19cb5d94852b252f6d32d8bcf62 2023-02-13 00:03:38,251 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/dbdeca7b6c6248c3ac9d995fcbaad566 to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/f2/dbdeca7b6c6248c3ac9d995fcbaad566 2023-02-13 00:03:38,255 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/recovered.edits/12.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141/recovered.edits/12.seqid 2023-02-13 00:03:38,256 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/ced57dbebf889853620545c25b19a141 2023-02-13 00:03:38,256 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/recovered.edits/6.seqid to hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/archive/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec/recovered.edits/6.seqid 2023-02-13 00:03:38,257 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/.tmp/data/default/testWithMapReduce/5fd8d083355a03b05437fe4a6ddb21ec 2023-02-13 00:03:38,257 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 00:03:38,260 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:03:38,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 00:03:38,287 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-13 00:03:38,292 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 00:03:38,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:03:38,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 00:03:38,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676246609565.a5008e8e7077dcb7a211705461185553.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,295 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246618294"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,298 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 00:03:38,298 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5fbc423bd225efe8d3c0c264305faab3, NAME => 'testWithMapReduce,,1676246609565.5fbc423bd225efe8d3c0c264305faab3.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 80cbbd1557f99d8399d9bef4febabb4d, NAME => 'testWithMapReduce,aaa,1676246609565.80cbbd1557f99d8399d9bef4febabb4d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => e2c1534c85d18491550a0e42706666ed, NAME => 'testWithMapReduce,d\x84\x84,1676246609565.e2c1534c85d18491550a0e42706666ed.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 34e9215f152c749d1b2855bf5988c248, NAME => 'testWithMapReduce,g\xA7\xA7,1676246609565.34e9215f152c749d1b2855bf5988c248.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => e2f1890c8e2d83f800fa4dfa489f5d90, NAME => 'testWithMapReduce,j\xCA\xCA,1676246609565.e2f1890c8e2d83f800fa4dfa489f5d90.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => a5008e8e7077dcb7a211705461185553, NAME => 'testWithMapReduce,m\xED\xED,1676246609565.a5008e8e7077dcb7a211705461185553.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 0e7c1f9de8c918de0f291881e0de540b, NAME => 'testWithMapReduce,q\x11\x10,1676246609565.0e7c1f9de8c918de0f291881e0de540b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => a8d913dcb78336766996717a08757b81, NAME => 'testWithMapReduce,t43,1676246609565.a8d913dcb78336766996717a08757b81.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => ced57dbebf889853620545c25b19a141, NAME => 'testWithMapReduce,wWV,1676246609565.ced57dbebf889853620545c25b19a141.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 5fd8d083355a03b05437fe4a6ddb21ec, NAME => 'testWithMapReduce,zz{,1676246609565.5fd8d083355a03b05437fe4a6ddb21ec.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 00:03:38,298 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 00:03:38,298 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676246618298"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:38,301 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 00:03:38,303 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:03:38,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 147 msec 2023-02-13 00:03:38,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43853] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 00:03:38,473 INFO [Listener at localhost/40573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-13 00:03:38,473 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:03:38,473 INFO [Listener at localhost/40573] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:03:38,473 DEBUG [Listener at localhost/40573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78a8a201 to 127.0.0.1:53518 2023-02-13 00:03:38,473 DEBUG [Listener at localhost/40573] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:38,473 DEBUG [Listener at localhost/40573] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:03:38,473 DEBUG [Listener at localhost/40573] util.JVMClusterUtil(257): Found active master hash=1505825656, stopped=false 2023-02-13 00:03:38,474 INFO [Listener at localhost/40573] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:38,477 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:38,477 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:38,477 INFO [Listener at localhost/40573] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:03:38,477 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:38,478 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:38,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:38,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:38,479 DEBUG [Listener at localhost/40573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1848ebed to 127.0.0.1:53518 2023-02-13 00:03:38,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:38,479 DEBUG [Listener at localhost/40573] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:38,479 INFO [Listener at localhost/40573] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38931,1676246606668' ***** 2023-02-13 00:03:38,479 INFO [Listener at localhost/40573] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:38,479 INFO [Listener at localhost/40573] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42817,1676246606714' ***** 2023-02-13 00:03:38,479 INFO [Listener at localhost/40573] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:38,480 INFO [RS:0;jenkins-hbase4:38931] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:38,480 INFO [RS:1;jenkins-hbase4:42817] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:38,480 INFO [RS:1;jenkins-hbase4:42817] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:38,480 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:38,480 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:38,480 INFO [RS:0;jenkins-hbase4:38931] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:38,481 INFO [RS:0;jenkins-hbase4:38931] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:38,481 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(3304): Received CLOSE for 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:38,482 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:38,482 DEBUG [RS:0;jenkins-hbase4:38931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ef028a8 to 127.0.0.1:53518 2023-02-13 00:03:38,480 INFO [RS:1;jenkins-hbase4:42817] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:38,482 DEBUG [RS:0;jenkins-hbase4:38931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:38,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 51fe59f9eaa311304d170570896f0eeb, disabling compactions & flushes 2023-02-13 00:03:38,482 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:38,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:38,482 DEBUG [RS:1;jenkins-hbase4:42817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x160b7df9 to 127.0.0.1:53518 2023-02-13 00:03:38,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:38,482 DEBUG [RS:1;jenkins-hbase4:42817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:38,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. after waiting 0 ms 2023-02-13 00:03:38,483 INFO [RS:1;jenkins-hbase4:42817] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:38,483 INFO [RS:1;jenkins-hbase4:42817] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:38,483 INFO [RS:1;jenkins-hbase4:42817] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:38,482 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 00:03:38,483 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:03:38,483 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1479): Online Regions={51fe59f9eaa311304d170570896f0eeb=hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb.} 2023-02-13 00:03:38,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:38,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 51fe59f9eaa311304d170570896f0eeb 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:03:38,485 DEBUG [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1505): Waiting on 51fe59f9eaa311304d170570896f0eeb 2023-02-13 00:03:38,486 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 00:03:38,486 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 00:03:38,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:38,487 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:03:38,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:38,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:38,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:38,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:38,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-13 00:03:38,506 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:38,506 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:38,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/.tmp/info/287cb4be4e5a498a89fe8df543ec74a3 2023-02-13 00:03:38,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/.tmp/info/34727237fdb14328866c0f7eecd57ef9 2023-02-13 00:03:38,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/.tmp/info/287cb4be4e5a498a89fe8df543ec74a3 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/info/287cb4be4e5a498a89fe8df543ec74a3 2023-02-13 00:03:38,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34727237fdb14328866c0f7eecd57ef9 2023-02-13 00:03:38,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/info/287cb4be4e5a498a89fe8df543ec74a3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:03:38,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 51fe59f9eaa311304d170570896f0eeb in 70ms, sequenceid=6, compaction requested=false 2023-02-13 00:03:38,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/namespace/51fe59f9eaa311304d170570896f0eeb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:03:38,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:38,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 51fe59f9eaa311304d170570896f0eeb: Waiting for close lock at 1676246618482Running coprocessor pre-close hooks at 1676246618482Disabling compacts and flushes for region at 1676246618482Disabling writes for close at 1676246618483 (+1 ms)Obtaining lock to block concurrent updates at 1676246618483Preparing flush snapshotting stores in 51fe59f9eaa311304d170570896f0eeb at 1676246618483Finished memstore snapshotting hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246618483Flushing stores of hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. at 1676246618484 (+1 ms)Flushing 51fe59f9eaa311304d170570896f0eeb/info: creating writer at 1676246618484Flushing 51fe59f9eaa311304d170570896f0eeb/info: appending metadata at 1676246618488 (+4 ms)Flushing 51fe59f9eaa311304d170570896f0eeb/info: closing flushed file at 1676246618488Flushing 51fe59f9eaa311304d170570896f0eeb/info: reopening flushed file at 1676246618532 (+44 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 51fe59f9eaa311304d170570896f0eeb in 70ms, sequenceid=6, compaction requested=false at 1676246618553 (+21 ms)Writing region close event to WAL at 1676246618593 (+40 ms)Running coprocessor post-close hooks at 1676246618609 (+16 ms)Closed at 1676246618610 (+1 ms) 2023-02-13 00:03:38,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246608688.51fe59f9eaa311304d170570896f0eeb. 2023-02-13 00:03:38,685 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38931,1676246606668; all regions closed. 2023-02-13 00:03:38,687 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:03:38,694 DEBUG [RS:0;jenkins-hbase4:38931] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/oldWALs 2023-02-13 00:03:38,694 INFO [RS:0;jenkins-hbase4:38931] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38931%2C1676246606668:(num 1676246609126) 2023-02-13 00:03:38,694 DEBUG [RS:0;jenkins-hbase4:38931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:38,695 INFO [RS:0;jenkins-hbase4:38931] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:38,695 INFO [RS:0;jenkins-hbase4:38931] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:38,695 INFO [RS:0;jenkins-hbase4:38931] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:38,695 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:38,695 INFO [RS:0;jenkins-hbase4:38931] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:38,695 INFO [RS:0;jenkins-hbase4:38931] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:38,697 INFO [RS:0;jenkins-hbase4:38931] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38931 2023-02-13 00:03:38,705 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:38,705 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:38,705 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38931,1676246606668 2023-02-13 00:03:38,705 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:38,705 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:38,705 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a55d954 rejected from java.util.concurrent.ThreadPoolExecutor@7e6a42c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:38,706 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38931,1676246606668] 2023-02-13 00:03:38,706 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38931,1676246606668; numProcessing=1 2023-02-13 00:03:38,707 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38931,1676246606668 already deleted, retry=false 2023-02-13 00:03:38,707 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38931,1676246606668 expired; onlineServers=1 2023-02-13 00:03:38,887 DEBUG [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:03:38,979 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:38,979 INFO [RS:0;jenkins-hbase4:38931] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38931,1676246606668; zookeeper connection closed. 2023-02-13 00:03:38,979 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e52822d rejected from java.util.concurrent.ThreadPoolExecutor@7e6a42c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:38,979 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:38931-0x1004afd44d30001, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:38,979 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65890059] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65890059 2023-02-13 00:03:38,979 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2649602d rejected from java.util.concurrent.ThreadPoolExecutor@7e6a42c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:39,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/.tmp/rep_barrier/0decd699069b40119170608848226091 2023-02-13 00:03:39,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0decd699069b40119170608848226091 2023-02-13 00:03:39,034 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/.tmp/table/8110bc663fed48baaaebb648aa58cea8 2023-02-13 00:03:39,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8110bc663fed48baaaebb648aa58cea8 2023-02-13 00:03:39,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/.tmp/info/34727237fdb14328866c0f7eecd57ef9 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/info/34727237fdb14328866c0f7eecd57ef9 2023-02-13 00:03:39,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34727237fdb14328866c0f7eecd57ef9 2023-02-13 00:03:39,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/info/34727237fdb14328866c0f7eecd57ef9, entries=30, sequenceid=57, filesize=7.9 K 2023-02-13 00:03:39,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/.tmp/rep_barrier/0decd699069b40119170608848226091 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/rep_barrier/0decd699069b40119170608848226091 2023-02-13 00:03:39,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0decd699069b40119170608848226091 2023-02-13 00:03:39,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/rep_barrier/0decd699069b40119170608848226091, entries=10, sequenceid=57, filesize=5.9 K 2023-02-13 00:03:39,054 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/.tmp/table/8110bc663fed48baaaebb648aa58cea8 as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/table/8110bc663fed48baaaebb648aa58cea8 2023-02-13 00:03:39,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8110bc663fed48baaaebb648aa58cea8 2023-02-13 00:03:39,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/table/8110bc663fed48baaaebb648aa58cea8, entries=13, sequenceid=57, filesize=5.9 K 2023-02-13 00:03:39,062 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 575ms, sequenceid=57, compaction requested=false 2023-02-13 00:03:39,063 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 00:03:39,063 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 00:03:39,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 00:03:39,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:03:39,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:39,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246618486Running coprocessor pre-close hooks at 1676246618486Disabling compacts and flushes for region at 1676246618486Disabling writes for close at 1676246618487 (+1 ms)Obtaining lock to block concurrent updates at 1676246618487Preparing flush snapshotting stores in 1588230740 at 1676246618487Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676246618488 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676246618488Flushing 1588230740/info: creating writer at 1676246618488Flushing 1588230740/info: appending metadata at 1676246618494 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676246618494Flushing 1588230740/rep_barrier: creating writer at 1676246618544 (+50 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676246618564 (+20 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676246618565 (+1 ms)Flushing 1588230740/table: creating writer at 1676246619021 (+456 ms)Flushing 1588230740/table: appending metadata at 1676246619024 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676246619024Flushing 1588230740/info: reopening flushed file at 1676246619041 (+17 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676246619048 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676246619054 (+6 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 575ms, sequenceid=57, compaction requested=false at 1676246619062 (+8 ms)Writing region close event to WAL at 1676246619067 (+5 ms)Running coprocessor post-close hooks at 1676246619070 (+3 ms)Closed at 1676246619071 (+1 ms) 2023-02-13 00:03:39,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:39,088 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42817,1676246606714; all regions closed. 2023-02-13 00:03:39,093 DEBUG [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/oldWALs 2023-02-13 00:03:39,093 INFO [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42817%2C1676246606714.meta:.meta(num 1676246608412) 2023-02-13 00:03:39,098 DEBUG [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/oldWALs 2023-02-13 00:03:39,098 INFO [RS:1;jenkins-hbase4:42817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42817%2C1676246606714:(num 1676246609127) 2023-02-13 00:03:39,098 DEBUG [RS:1;jenkins-hbase4:42817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:39,098 INFO [RS:1;jenkins-hbase4:42817] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:39,099 INFO [RS:1;jenkins-hbase4:42817] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:39,099 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:39,100 INFO [RS:1;jenkins-hbase4:42817] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42817 2023-02-13 00:03:39,103 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:39,103 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42817,1676246606714 2023-02-13 00:03:39,103 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30f1227a rejected from java.util.concurrent.ThreadPoolExecutor@34ceb0bc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:39,104 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42817,1676246606714] 2023-02-13 00:03:39,104 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42817,1676246606714; numProcessing=2 2023-02-13 00:03:39,107 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42817,1676246606714 already deleted, retry=false 2023-02-13 00:03:39,107 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42817,1676246606714 expired; onlineServers=0 2023-02-13 00:03:39,107 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43853,1676246605448' ***** 2023-02-13 00:03:39,107 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:03:39,108 DEBUG [M:0;jenkins-hbase4:43853] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18fc1943, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:39,108 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43853,1676246605448 2023-02-13 00:03:39,108 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43853,1676246605448; all regions closed. 2023-02-13 00:03:39,108 DEBUG [M:0;jenkins-hbase4:43853] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:39,108 DEBUG [M:0;jenkins-hbase4:43853] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:03:39,108 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:03:39,108 DEBUG [M:0;jenkins-hbase4:43853] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:03:39,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246607868] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246607868,5,FailOnTimeoutGroup] 2023-02-13 00:03:39,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246607864] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246607864,5,FailOnTimeoutGroup] 2023-02-13 00:03:39,109 INFO [M:0;jenkins-hbase4:43853] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:03:39,110 INFO [M:0;jenkins-hbase4:43853] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:03:39,110 INFO [M:0;jenkins-hbase4:43853] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:03:39,111 DEBUG [M:0;jenkins-hbase4:43853] master.HMaster(1502): Stopping service threads 2023-02-13 00:03:39,111 INFO [M:0;jenkins-hbase4:43853] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:03:39,111 ERROR [M:0;jenkins-hbase4:43853] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-13 00:03:39,111 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:39,112 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:39,112 INFO [M:0;jenkins-hbase4:43853] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:03:39,112 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:03:39,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:39,113 DEBUG [M:0;jenkins-hbase4:43853] zookeeper.ZKUtil(398): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 00:03:39,113 WARN [M:0;jenkins-hbase4:43853] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 00:03:39,113 INFO [M:0;jenkins-hbase4:43853] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:03:39,114 INFO [M:0;jenkins-hbase4:43853] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:03:39,114 DEBUG [M:0;jenkins-hbase4:43853] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:39,114 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:39,115 DEBUG [M:0;jenkins-hbase4:43853] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:39,115 DEBUG [M:0;jenkins-hbase4:43853] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:39,115 DEBUG [M:0;jenkins-hbase4:43853] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:39,115 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.28 KB heapSize=192.19 KB 2023-02-13 00:03:39,135 INFO [M:0;jenkins-hbase4:43853] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.28 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/430cf97a59324c7581bb30434ac26adb 2023-02-13 00:03:39,142 DEBUG [M:0;jenkins-hbase4:43853] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/430cf97a59324c7581bb30434ac26adb as hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/430cf97a59324c7581bb30434ac26adb 2023-02-13 00:03:39,147 INFO [M:0;jenkins-hbase4:43853] regionserver.HStore(1080): Added hdfs://localhost:42801/user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/430cf97a59324c7581bb30434ac26adb, entries=53, sequenceid=357, filesize=10.4 K 2023-02-13 00:03:39,149 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegion(2947): Finished flush of dataSize ~159.28 KB/163106, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=357, compaction requested=false 2023-02-13 00:03:39,151 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:39,151 DEBUG [M:0;jenkins-hbase4:43853] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246619114Disabling compacts and flushes for region at 1676246619114Disabling writes for close at 1676246619115 (+1 ms)Obtaining lock to block concurrent updates at 1676246619115Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246619115Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163106, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1676246619115Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246619116 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246619117 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246619121 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246619121Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246619142 (+21 ms)Finished flush of dataSize ~159.28 KB/163106, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=357, compaction requested=false at 1676246619149 (+7 ms)Writing region close event to WAL at 1676246619151 (+2 ms)Closed at 1676246619151 2023-02-13 00:03:39,156 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f4afa0da-f64e-8f08-c223-7e54bfc6c23d/MasterData/WALs/jenkins-hbase4.apache.org,43853,1676246605448/jenkins-hbase4.apache.org%2C43853%2C1676246605448.1676246607176 not finished, retry = 0 2023-02-13 00:03:39,205 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:39,205 INFO [RS:1;jenkins-hbase4:42817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42817,1676246606714; zookeeper connection closed. 2023-02-13 00:03:39,205 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79ac650f rejected from java.util.concurrent.ThreadPoolExecutor@34ceb0bc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:39,205 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@419f1752] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@419f1752 2023-02-13 00:03:39,205 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): regionserver:42817-0x1004afd44d30002, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:39,205 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1fd6950 rejected from java.util.concurrent.ThreadPoolExecutor@34ceb0bc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:39,205 INFO [Listener at localhost/40573] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:03:39,257 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:39,257 INFO [M:0;jenkins-hbase4:43853] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:03:39,258 INFO [M:0;jenkins-hbase4:43853] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43853 2023-02-13 00:03:39,261 DEBUG [M:0;jenkins-hbase4:43853] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43853,1676246605448 already deleted, retry=false 2023-02-13 00:03:39,363 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:39,363 INFO [M:0;jenkins-hbase4:43853] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43853,1676246605448; zookeeper connection closed. 2023-02-13 00:03:39,363 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32783e94 rejected from java.util.concurrent.ThreadPoolExecutor@6b796523[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:39,363 DEBUG [Listener at localhost/40573-EventThread] zookeeper.ZKWatcher(600): master:43853-0x1004afd44d30000, quorum=127.0.0.1:53518, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:39,363 ERROR [Listener at localhost/40573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23729a07 rejected from java.util.concurrent.ThreadPoolExecutor@6b796523[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:39,365 WARN [Listener at localhost/40573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:03:39,369 INFO [Listener at localhost/40573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:39,472 WARN [BP-301289649-172.31.14.131-1676246601990 heartbeating to localhost/127.0.0.1:42801] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:03:39,472 WARN [BP-301289649-172.31.14.131-1676246601990 heartbeating to localhost/127.0.0.1:42801] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-301289649-172.31.14.131-1676246601990 (Datanode Uuid dc29ff12-4c3d-4d52-b204-640b9404ebd7) service to localhost/127.0.0.1:42801 2023-02-13 00:03:39,473 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/dfs/data/data3/current/BP-301289649-172.31.14.131-1676246601990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:39,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/dfs/data/data4/current/BP-301289649-172.31.14.131-1676246601990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:39,475 WARN [Listener at localhost/40573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:03:39,478 INFO [Listener at localhost/40573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:39,582 WARN [BP-301289649-172.31.14.131-1676246601990 heartbeating to localhost/127.0.0.1:42801] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:03:39,582 WARN [BP-301289649-172.31.14.131-1676246601990 heartbeating to localhost/127.0.0.1:42801] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-301289649-172.31.14.131-1676246601990 (Datanode Uuid 0ba714d2-aaec-4d5b-a12b-75321a20e182) service to localhost/127.0.0.1:42801 2023-02-13 00:03:39,582 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/dfs/data/data1/current/BP-301289649-172.31.14.131-1676246601990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:39,583 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/cluster_d5754c42-48ed-a036-da3b-e598f20bbc3a/dfs/data/data2/current/BP-301289649-172.31.14.131-1676246601990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:39,618 INFO [Listener at localhost/40573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:39,774 INFO [Listener at localhost/40573] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:03:39,843 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:03:39,856 INFO [Listener at localhost/40573] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=101 (was 7) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:42801 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1872b062 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:42801 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: (jenkins-hbase4.apache.org,43853,1676246605448)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40573 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:42801 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:42801 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42801 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:42801 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:42801 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=531 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 153) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4132 (was 5217) 2023-02-13 00:03:39,865 INFO [Listener at localhost/40573] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=101, OpenFileDescriptor=531, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=4131 2023-02-13 00:03:39,875 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop.log.dir so I do NOT create it in target/test-data/163d40af-35f2-28dc-1954-b28e437d8736 2023-02-13 00:03:39,875 WARN [Listener at localhost/40573] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 00:03:39,875 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop.tmp.dir so I do NOT create it in target/test-data/163d40af-35f2-28dc-1954-b28e437d8736 2023-02-13 00:03:39,875 WARN [Listener at localhost/40573] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfea5d4b-03fe-92f4-51c5-c7bbfc26bfa4/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 00:03:39,875 DEBUG [Listener at localhost/40573] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1, deleteOnExit=true 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/test.cache.data in system properties and HBase conf 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:03:39,876 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:03:39,877 DEBUG [Listener at localhost/40573] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:39,877 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:39,878 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:03:39,878 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:03:39,878 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:03:39,878 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:39,878 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:03:39,878 INFO [Listener at localhost/40573] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:03:39,882 WARN [Listener at localhost/40573] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:39,882 WARN [Listener at localhost/40573] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:39,925 WARN [Listener at localhost/40573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:39,927 INFO [Listener at localhost/40573] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:39,934 INFO [Listener at localhost/40573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/java.io.tmpdir/Jetty_localhost_41817_hdfs____mmu3xn/webapp 2023-02-13 00:03:40,029 INFO [Listener at localhost/40573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41817 2023-02-13 00:03:40,033 WARN [Listener at localhost/40573] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:40,034 WARN [Listener at localhost/40573] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:40,078 WARN [Listener at localhost/32903] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:40,097 WARN [Listener at localhost/32903] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:40,100 WARN [Listener at localhost/32903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:40,101 INFO [Listener at localhost/32903] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:40,108 INFO [Listener at localhost/32903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/java.io.tmpdir/Jetty_localhost_39951_datanode____lgwonq/webapp 2023-02-13 00:03:40,206 INFO [Listener at localhost/32903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39951 2023-02-13 00:03:40,213 WARN [Listener at localhost/33749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:40,230 WARN [Listener at localhost/33749] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:40,232 WARN [Listener at localhost/33749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:40,233 INFO [Listener at localhost/33749] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:40,237 INFO [Listener at localhost/33749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/java.io.tmpdir/Jetty_localhost_42051_datanode____kmjy45/webapp 2023-02-13 00:03:40,318 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe835ac0bdd033c5d: Processing first storage report for DS-fc8486f6-76b5-4075-a20e-220124f4b717 from datanode bc170a78-ab96-4482-8f77-131ffa3995c6 2023-02-13 00:03:40,319 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe835ac0bdd033c5d: from storage DS-fc8486f6-76b5-4075-a20e-220124f4b717 node DatanodeRegistration(127.0.0.1:34451, datanodeUuid=bc170a78-ab96-4482-8f77-131ffa3995c6, infoPort=41123, infoSecurePort=0, ipcPort=33749, storageInfo=lv=-57;cid=testClusterID;nsid=2013130857;c=1676246619885), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:40,319 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe835ac0bdd033c5d: Processing first storage report for DS-a1d5caf3-d3ad-48cd-b08a-e7576de0e129 from datanode bc170a78-ab96-4482-8f77-131ffa3995c6 2023-02-13 00:03:40,319 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe835ac0bdd033c5d: from storage DS-a1d5caf3-d3ad-48cd-b08a-e7576de0e129 node DatanodeRegistration(127.0.0.1:34451, datanodeUuid=bc170a78-ab96-4482-8f77-131ffa3995c6, infoPort=41123, infoSecurePort=0, ipcPort=33749, storageInfo=lv=-57;cid=testClusterID;nsid=2013130857;c=1676246619885), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:40,341 INFO [Listener at localhost/33749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42051 2023-02-13 00:03:40,351 WARN [Listener at localhost/38137] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:40,446 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xef85f4536a6f61ac: Processing first storage report for DS-7c943a14-b2b9-4292-97d6-0beab009a041 from datanode 1f3c1c82-95c7-4f45-b177-4519ab52e67d 2023-02-13 00:03:40,446 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xef85f4536a6f61ac: from storage DS-7c943a14-b2b9-4292-97d6-0beab009a041 node DatanodeRegistration(127.0.0.1:38841, datanodeUuid=1f3c1c82-95c7-4f45-b177-4519ab52e67d, infoPort=34805, infoSecurePort=0, ipcPort=38137, storageInfo=lv=-57;cid=testClusterID;nsid=2013130857;c=1676246619885), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:40,446 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xef85f4536a6f61ac: Processing first storage report for DS-f101bedb-1d2a-412f-813d-9cdaea040ef1 from datanode 1f3c1c82-95c7-4f45-b177-4519ab52e67d 2023-02-13 00:03:40,446 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xef85f4536a6f61ac: from storage DS-f101bedb-1d2a-412f-813d-9cdaea040ef1 node DatanodeRegistration(127.0.0.1:38841, datanodeUuid=1f3c1c82-95c7-4f45-b177-4519ab52e67d, infoPort=34805, infoSecurePort=0, ipcPort=38137, storageInfo=lv=-57;cid=testClusterID;nsid=2013130857;c=1676246619885), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:40,463 DEBUG [Listener at localhost/38137] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736 2023-02-13 00:03:40,465 INFO [Listener at localhost/38137] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/zookeeper_0, clientPort=60508, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:03:40,467 INFO [Listener at localhost/38137] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60508 2023-02-13 00:03:40,467 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,469 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,490 INFO [Listener at localhost/38137] util.FSUtils(479): Created version file at hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791 with version=8 2023-02-13 00:03:40,491 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,492 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,493 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/hbase-staging 2023-02-13 00:03:40,495 INFO [Listener at localhost/38137] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:40,496 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,496 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,496 INFO [Listener at localhost/38137] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:40,496 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,496 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:40,496 INFO [Listener at localhost/38137] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:40,497 INFO [Listener at localhost/38137] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44265 2023-02-13 00:03:40,498 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,499 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,500 INFO [Listener at localhost/38137] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44265 connecting to ZooKeeper ensemble=127.0.0.1:60508 2023-02-13 00:03:40,509 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:442650x0, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:40,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44265-0x1004afd82f60000 connected 2023-02-13 00:03:40,549 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:40,550 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:40,551 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:40,554 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44265 2023-02-13 00:03:40,554 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44265 2023-02-13 00:03:40,560 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44265 2023-02-13 00:03:40,562 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44265 2023-02-13 00:03:40,562 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44265 2023-02-13 00:03:40,563 INFO [Listener at localhost/38137] master.HMaster(439): hbase.rootdir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791, hbase.cluster.distributed=false 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:40,576 INFO [Listener at localhost/38137] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:40,580 INFO [Listener at localhost/38137] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44453 2023-02-13 00:03:40,581 INFO [Listener at localhost/38137] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:40,582 DEBUG [Listener at localhost/38137] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:40,583 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,584 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,585 INFO [Listener at localhost/38137] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44453 connecting to ZooKeeper ensemble=127.0.0.1:60508 2023-02-13 00:03:40,590 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:444530x0, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:40,591 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): regionserver:444530x0, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:40,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44453-0x1004afd82f60001 connected 2023-02-13 00:03:40,592 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:40,593 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:40,596 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44453 2023-02-13 00:03:40,596 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44453 2023-02-13 00:03:40,600 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44453 2023-02-13 00:03:40,602 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44453 2023-02-13 00:03:40,603 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44453 2023-02-13 00:03:40,621 INFO [Listener at localhost/38137] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:40,621 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,622 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,622 INFO [Listener at localhost/38137] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:40,622 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:40,622 INFO [Listener at localhost/38137] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:40,622 INFO [Listener at localhost/38137] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:40,624 INFO [Listener at localhost/38137] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35171 2023-02-13 00:03:40,625 INFO [Listener at localhost/38137] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:40,626 DEBUG [Listener at localhost/38137] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:40,627 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,628 INFO [Listener at localhost/38137] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,629 INFO [Listener at localhost/38137] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35171 connecting to ZooKeeper ensemble=127.0.0.1:60508 2023-02-13 00:03:40,635 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:351710x0, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:40,636 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): regionserver:351710x0, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:40,636 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): regionserver:351710x0, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:40,637 DEBUG [Listener at localhost/38137] zookeeper.ZKUtil(164): regionserver:351710x0, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:40,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35171-0x1004afd82f60002 connected 2023-02-13 00:03:40,642 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35171 2023-02-13 00:03:40,642 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35171 2023-02-13 00:03:40,644 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35171 2023-02-13 00:03:40,644 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35171 2023-02-13 00:03:40,646 DEBUG [Listener at localhost/38137] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35171 2023-02-13 00:03:40,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,650 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:40,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,651 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:40,651 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:40,652 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:40,652 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:40,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:40,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:40,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44265,1676246620495 from backup master directory 2023-02-13 00:03:40,657 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,657 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:40,657 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:40,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/hbase.id with ID: c7fc28ef-af91-429d-adfc-8dd09932adc9 2023-02-13 00:03:40,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:40,690 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:40,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x24ba5051 to 127.0.0.1:60508 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c5a7721, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:40,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:40,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:03:40,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:40,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store-tmp 2023-02-13 00:03:40,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:40,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:40,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:40,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:40,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:40,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:40,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:40,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246620724Disabling compacts and flushes for region at 1676246620724Disabling writes for close at 1676246620724Writing region close event to WAL at 1676246620724Closed at 1676246620724 2023-02-13 00:03:40,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/WALs/jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44265%2C1676246620495, suffix=, logDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/WALs/jenkins-hbase4.apache.org,44265,1676246620495, archiveDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/oldWALs, maxLogs=10 2023-02-13 00:03:40,745 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK] 2023-02-13 00:03:40,748 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK] 2023-02-13 00:03:40,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/WALs/jenkins-hbase4.apache.org,44265,1676246620495/jenkins-hbase4.apache.org%2C44265%2C1676246620495.1676246620728 2023-02-13 00:03:40,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK], DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK]] 2023-02-13 00:03:40,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:40,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:40,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:40,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:40,756 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:40,758 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:03:40,758 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:03:40,759 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:40,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:40,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:40,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:40,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:40,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64226995, jitterRate=-0.04294319450855255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:40,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246620751Initializing all the Stores at 1676246620752 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246620752Cleaning up temporary data from old regions at 1676246620761 (+9 ms)Cleaning up detritus from prior splits at 1676246620761Region opened successfully at 1676246620766 (+5 ms) 2023-02-13 00:03:40,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:03:40,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:03:40,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:03:40,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:03:40,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 00:03:40,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 00:03:40,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:03:40,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:03:40,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:03:40,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:03:40,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:03:40,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:03:40,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:03:40,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:03:40,788 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:40,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:03:40,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:03:40,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:03:40,793 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:40,793 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:40,793 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:40,793 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:40,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44265,1676246620495, sessionid=0x1004afd82f60000, setting cluster-up flag (Was=false) 2023-02-13 00:03:40,799 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:40,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:03:40,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,808 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:40,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:03:40,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:40,815 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.hbase-snapshot/.tmp 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:40,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246650825 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:03:40,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:03:40,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:03:40,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:03:40,827 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:40,828 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:03:40,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:03:40,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:03:40,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246620828,5,FailOnTimeoutGroup] 2023-02-13 00:03:40,829 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:40,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246620828,5,FailOnTimeoutGroup] 2023-02-13 00:03:40,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:03:40,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,846 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:40,846 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:40,846 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791 2023-02-13 00:03:40,848 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(952): ClusterId : c7fc28ef-af91-429d-adfc-8dd09932adc9 2023-02-13 00:03:40,848 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:40,850 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:40,850 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:40,855 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(952): ClusterId : c7fc28ef-af91-429d-adfc-8dd09932adc9 2023-02-13 00:03:40,855 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:40,856 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:40,857 DEBUG [RS:0;jenkins-hbase4:44453] zookeeper.ReadOnlyZKClient(139): Connect 0x7ace32d5 to 127.0.0.1:60508 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:40,858 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:40,858 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:40,861 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:40,868 DEBUG [RS:1;jenkins-hbase4:35171] zookeeper.ReadOnlyZKClient(139): Connect 0x13652343 to 127.0.0.1:60508 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:40,876 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:40,877 DEBUG [RS:0;jenkins-hbase4:44453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7409d3fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:40,877 DEBUG [RS:0;jenkins-hbase4:44453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@703659a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:40,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:40,880 DEBUG [RS:1;jenkins-hbase4:35171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1da2df5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:40,881 DEBUG [RS:1;jenkins-hbase4:35171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@199d4833, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:40,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/info 2023-02-13 00:03:40,885 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:40,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:40,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:40,886 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44453 2023-02-13 00:03:40,887 INFO [RS:0;jenkins-hbase4:44453] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:40,887 INFO [RS:0;jenkins-hbase4:44453] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:40,887 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:40,887 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44265,1676246620495 with isa=jenkins-hbase4.apache.org/172.31.14.131:44453, startcode=1676246620575 2023-02-13 00:03:40,888 DEBUG [RS:0;jenkins-hbase4:44453] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:40,888 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:40,889 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:40,889 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:40,889 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:40,891 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/table 2023-02-13 00:03:40,891 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:40,892 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:40,894 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35171 2023-02-13 00:03:40,894 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740 2023-02-13 00:03:40,894 INFO [RS:1;jenkins-hbase4:35171] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:40,894 INFO [RS:1;jenkins-hbase4:35171] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:40,894 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39975, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:40,894 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:40,894 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740 2023-02-13 00:03:40,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,896 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791 2023-02-13 00:03:40,896 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32903 2023-02-13 00:03:40,896 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:40,896 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44265,1676246620495 with isa=jenkins-hbase4.apache.org/172.31.14.131:35171, startcode=1676246620621 2023-02-13 00:03:40,896 DEBUG [RS:1;jenkins-hbase4:35171] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:40,898 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:40,899 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:40,899 DEBUG [RS:0;jenkins-hbase4:44453] zookeeper.ZKUtil(162): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,899 WARN [RS:0;jenkins-hbase4:44453] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:40,899 INFO [RS:0;jenkins-hbase4:44453] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:40,900 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,901 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:40,909 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57941, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:40,909 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44453,1676246620575] 2023-02-13 00:03:40,909 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:40,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,911 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74926657, jitterRate=0.11649419367313385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:40,911 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246620877Initializing all the Stores at 1676246620878 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246620878Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246620880 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246620880Cleaning up temporary data from old regions at 1676246620896 (+16 ms)Cleaning up detritus from prior splits at 1676246620897 (+1 ms)Region opened successfully at 1676246620911 (+14 ms) 2023-02-13 00:03:40,911 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791 2023-02-13 00:03:40,911 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:40,911 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32903 2023-02-13 00:03:40,912 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:40,912 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:40,912 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:40,912 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:40,912 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:40,916 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:40,916 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:40,916 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246620911Disabling compacts and flushes for region at 1676246620911Disabling writes for close at 1676246620912 (+1 ms)Writing region close event to WAL at 1676246620916 (+4 ms)Closed at 1676246620916 2023-02-13 00:03:40,916 DEBUG [RS:1;jenkins-hbase4:35171] zookeeper.ZKUtil(162): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,916 WARN [RS:1;jenkins-hbase4:35171] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:40,917 INFO [RS:1;jenkins-hbase4:35171] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:40,917 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,918 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:40,918 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:03:40,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:03:40,918 DEBUG [RS:0;jenkins-hbase4:44453] zookeeper.ZKUtil(162): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:03:40,920 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35171,1676246620621] 2023-02-13 00:03:40,921 DEBUG [RS:0;jenkins-hbase4:44453] zookeeper.ZKUtil(162): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,921 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:03:40,924 DEBUG [RS:1;jenkins-hbase4:35171] zookeeper.ZKUtil(162): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,924 DEBUG [RS:1;jenkins-hbase4:35171] zookeeper.ZKUtil(162): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,924 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:40,924 INFO [RS:0;jenkins-hbase4:44453] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:40,927 INFO [RS:0;jenkins-hbase4:44453] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:40,927 INFO [RS:0;jenkins-hbase4:44453] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:40,927 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,929 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:40,929 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:40,930 INFO [RS:1;jenkins-hbase4:35171] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:40,931 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,931 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,932 DEBUG [RS:0;jenkins-hbase4:44453] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,937 INFO [RS:1;jenkins-hbase4:35171] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:40,937 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,937 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,937 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,937 INFO [RS:1;jenkins-hbase4:35171] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:40,937 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,940 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:40,941 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,941 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,941 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,941 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,941 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,941 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,942 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:40,942 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,942 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,942 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,942 DEBUG [RS:1;jenkins-hbase4:35171] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:40,944 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,945 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,945 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,954 INFO [RS:0;jenkins-hbase4:44453] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:40,954 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44453,1676246620575-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,956 INFO [RS:1;jenkins-hbase4:35171] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:40,956 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35171,1676246620621-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:40,973 INFO [RS:1;jenkins-hbase4:35171] regionserver.Replication(203): jenkins-hbase4.apache.org,35171,1676246620621 started 2023-02-13 00:03:40,973 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35171,1676246620621, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35171, sessionid=0x1004afd82f60002 2023-02-13 00:03:40,976 INFO [RS:0;jenkins-hbase4:44453] regionserver.Replication(203): jenkins-hbase4.apache.org,44453,1676246620575 started 2023-02-13 00:03:40,976 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:40,976 DEBUG [RS:1;jenkins-hbase4:35171] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,976 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44453,1676246620575, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44453, sessionid=0x1004afd82f60001 2023-02-13 00:03:40,976 DEBUG [RS:1;jenkins-hbase4:35171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35171,1676246620621' 2023-02-13 00:03:40,976 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:40,976 DEBUG [RS:0;jenkins-hbase4:44453] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,976 DEBUG [RS:0;jenkins-hbase4:44453] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44453,1676246620575' 2023-02-13 00:03:40,976 DEBUG [RS:0;jenkins-hbase4:44453] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:40,976 DEBUG [RS:1;jenkins-hbase4:35171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:40,977 DEBUG [RS:0;jenkins-hbase4:44453] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:40,977 DEBUG [RS:1;jenkins-hbase4:35171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:40,977 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:40,977 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:40,977 DEBUG [RS:0;jenkins-hbase4:44453] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:40,977 DEBUG [RS:0;jenkins-hbase4:44453] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44453,1676246620575' 2023-02-13 00:03:40,977 DEBUG [RS:0;jenkins-hbase4:44453] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:40,977 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:40,978 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:40,978 DEBUG [RS:1;jenkins-hbase4:35171] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:40,978 DEBUG [RS:1;jenkins-hbase4:35171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35171,1676246620621' 2023-02-13 00:03:40,978 DEBUG [RS:1;jenkins-hbase4:35171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:40,978 DEBUG [RS:0;jenkins-hbase4:44453] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:40,978 DEBUG [RS:1;jenkins-hbase4:35171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:40,978 DEBUG [RS:0;jenkins-hbase4:44453] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:40,978 INFO [RS:0;jenkins-hbase4:44453] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:40,978 INFO [RS:0;jenkins-hbase4:44453] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:40,978 DEBUG [RS:1;jenkins-hbase4:35171] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:40,979 INFO [RS:1;jenkins-hbase4:35171] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:40,979 INFO [RS:1;jenkins-hbase4:35171] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:41,072 DEBUG [jenkins-hbase4:44265] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:03:41,073 DEBUG [jenkins-hbase4:44265] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:41,075 DEBUG [jenkins-hbase4:44265] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:41,075 DEBUG [jenkins-hbase4:44265] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:41,075 DEBUG [jenkins-hbase4:44265] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:41,076 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44453,1676246620575, state=OPENING 2023-02-13 00:03:41,077 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:03:41,079 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:41,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44453,1676246620575}] 2023-02-13 00:03:41,079 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:41,234 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:41,235 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:41,238 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:41,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:03:41,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:41,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44453%2C1676246620575.meta, suffix=.meta, logDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,44453,1676246620575, archiveDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/oldWALs, maxLogs=32 2023-02-13 00:03:41,309 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK] 2023-02-13 00:03:41,310 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK] 2023-02-13 00:03:41,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,44453,1676246620575/jenkins-hbase4.apache.org%2C44453%2C1676246620575.meta.1676246621268.meta 2023-02-13 00:03:41,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK], DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK]] 2023-02-13 00:03:41,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:41,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:03:41,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:03:41,334 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:03:41,334 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:03:41,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:41,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:03:41,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:03:41,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:41,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/info 2023-02-13 00:03:41,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/info 2023-02-13 00:03:41,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:41,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:41,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:41,344 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:41,344 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:41,344 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:41,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:41,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:41,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/table 2023-02-13 00:03:41,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/table 2023-02-13 00:03:41,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:41,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:41,351 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740 2023-02-13 00:03:41,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740 2023-02-13 00:03:41,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:41,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:41,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71404890, jitterRate=0.06401577591896057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:41,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246621335Writing region info on filesystem at 1676246621335Initializing all the Stores at 1676246621336 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246621336Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246621340 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246621340Cleaning up temporary data from old regions at 1676246621354 (+14 ms)Cleaning up detritus from prior splits at 1676246621355 (+1 ms)Running coprocessor post-open hooks at 1676246621358 (+3 ms)Region opened successfully at 1676246621358 2023-02-13 00:03:41,360 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246621234 2023-02-13 00:03:41,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:03:41,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:03:41,366 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44453,1676246620575, state=OPEN 2023-02-13 00:03:41,369 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:03:41,369 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:41,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:03:41,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44453,1676246620575 in 290 msec 2023-02-13 00:03:41,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:03:41,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 453 msec 2023-02-13 00:03:41,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 560 msec 2023-02-13 00:03:41,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246620650, completionTime=-1 2023-02-13 00:03:41,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:03:41,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:03:41,388 DEBUG [hconnection-0x691edf26-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:41,394 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:41,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:03:41,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246681396 2023-02-13 00:03:41,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246741396 2023-02-13 00:03:41,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 19 msec 2023-02-13 00:03:41,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44265,1676246620495-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:41,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44265,1676246620495-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:41,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44265,1676246620495-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:41,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44265, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:41,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:41,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:03:41,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:41,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:03:41,418 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:41,418 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:03:41,418 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:41,420 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,420 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f empty. 2023-02-13 00:03:41,421 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,421 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:03:41,449 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:41,456 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4cd3b881a1bf99f85f12fac230071c9f, NAME => 'hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:41,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:41,480 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4cd3b881a1bf99f85f12fac230071c9f, disabling compactions & flushes 2023-02-13 00:03:41,481 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. after waiting 0 ms 2023-02-13 00:03:41,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,481 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4cd3b881a1bf99f85f12fac230071c9f: Waiting for close lock at 1676246621480Disabling compacts and flushes for region at 1676246621480Disabling writes for close at 1676246621481 (+1 ms)Writing region close event to WAL at 1676246621481Closed at 1676246621481 2023-02-13 00:03:41,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:41,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246621490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246621490"}]},"ts":"1676246621490"} 2023-02-13 00:03:41,494 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:03:41,495 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:41,495 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246621495"}]},"ts":"1676246621495"} 2023-02-13 00:03:41,498 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:03:41,511 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:41,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:41,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:41,512 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:41,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4cd3b881a1bf99f85f12fac230071c9f, ASSIGN}] 2023-02-13 00:03:41,517 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4cd3b881a1bf99f85f12fac230071c9f, ASSIGN 2023-02-13 00:03:41,518 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4cd3b881a1bf99f85f12fac230071c9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35171,1676246620621; forceNewPlan=false, retain=false 2023-02-13 00:03:41,670 INFO [jenkins-hbase4:44265] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:03:41,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4cd3b881a1bf99f85f12fac230071c9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:41,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246621671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246621671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246621671"}]},"ts":"1676246621671"} 2023-02-13 00:03:41,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4cd3b881a1bf99f85f12fac230071c9f, server=jenkins-hbase4.apache.org,35171,1676246620621}] 2023-02-13 00:03:41,828 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:41,828 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:41,831 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:41,835 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,837 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35171%2C1676246620621, suffix=, logDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,35171,1676246620621, archiveDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/oldWALs, maxLogs=32 2023-02-13 00:03:41,856 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK] 2023-02-13 00:03:41,859 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK] 2023-02-13 00:03:41,865 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,35171,1676246620621/jenkins-hbase4.apache.org%2C35171%2C1676246620621.1676246621838 2023-02-13 00:03:41,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK], DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK]] 2023-02-13 00:03:41,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4cd3b881a1bf99f85f12fac230071c9f, NAME => 'hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:41,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:41,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,867 INFO [StoreOpener-4cd3b881a1bf99f85f12fac230071c9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,869 DEBUG [StoreOpener-4cd3b881a1bf99f85f12fac230071c9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/info 2023-02-13 00:03:41,869 DEBUG [StoreOpener-4cd3b881a1bf99f85f12fac230071c9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/info 2023-02-13 00:03:41,869 INFO [StoreOpener-4cd3b881a1bf99f85f12fac230071c9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cd3b881a1bf99f85f12fac230071c9f columnFamilyName info 2023-02-13 00:03:41,870 INFO [StoreOpener-4cd3b881a1bf99f85f12fac230071c9f-1] regionserver.HStore(310): Store=4cd3b881a1bf99f85f12fac230071c9f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:41,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:41,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:41,876 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4cd3b881a1bf99f85f12fac230071c9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67354417, jitterRate=0.0036590248346328735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:41,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4cd3b881a1bf99f85f12fac230071c9f: Running coprocessor pre-open hook at 1676246621866Writing region info on filesystem at 1676246621866Initializing all the Stores at 1676246621867 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246621867Cleaning up temporary data from old regions at 1676246621871 (+4 ms)Cleaning up detritus from prior splits at 1676246621872 (+1 ms)Running coprocessor post-open hooks at 1676246621876 (+4 ms)Region opened successfully at 1676246621876 2023-02-13 00:03:41,877 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f., pid=6, masterSystemTime=1676246621828 2023-02-13 00:03:41,882 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,882 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:41,883 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4cd3b881a1bf99f85f12fac230071c9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:41,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246621882"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246621882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246621882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246621882"}]},"ts":"1676246621882"} 2023-02-13 00:03:41,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:03:41,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4cd3b881a1bf99f85f12fac230071c9f, server=jenkins-hbase4.apache.org,35171,1676246620621 in 211 msec 2023-02-13 00:03:41,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:03:41,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4cd3b881a1bf99f85f12fac230071c9f, ASSIGN in 374 msec 2023-02-13 00:03:41,890 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:41,890 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246621890"}]},"ts":"1676246621890"} 2023-02-13 00:03:41,891 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:03:41,894 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:41,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 482 msec 2023-02-13 00:03:41,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:03:41,916 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:41,916 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:41,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:41,922 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60546, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:41,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:03:41,937 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:41,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 16 msec 2023-02-13 00:03:41,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:03:41,954 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:41,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-13 00:03:41,971 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:03:41,973 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:03:41,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.317sec 2023-02-13 00:03:41,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:03:41,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:03:41,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:03:41,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44265,1676246620495-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:03:41,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44265,1676246620495-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:03:41,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:03:41,981 INFO [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44453%2C1676246620575, suffix=, logDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,44453,1676246620575, archiveDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/oldWALs, maxLogs=32 2023-02-13 00:03:41,998 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK] 2023-02-13 00:03:41,998 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK] 2023-02-13 00:03:42,001 INFO [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/WALs/jenkins-hbase4.apache.org,44453,1676246620575/jenkins-hbase4.apache.org%2C44453%2C1676246620575.1676246621982 2023-02-13 00:03:42,001 DEBUG [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34451,DS-fc8486f6-76b5-4075-a20e-220124f4b717,DISK], DatanodeInfoWithStorage[127.0.0.1:38841,DS-7c943a14-b2b9-4292-97d6-0beab009a041,DISK]] 2023-02-13 00:03:42,054 DEBUG [Listener at localhost/38137] zookeeper.ReadOnlyZKClient(139): Connect 0x7f12cae5 to 127.0.0.1:60508 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:42,059 DEBUG [Listener at localhost/38137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47637cda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:42,061 DEBUG [hconnection-0x79128360-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:42,063 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:42,065 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:42,065 DEBUG [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:03:42,067 DEBUG [Listener at localhost/38137] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:03:42,069 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:03:42,069 INFO [Listener at localhost/38137] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 00:03:42,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 00:03:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:03:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:50778 deadline: 1676246682070, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 00:03:42,071 INFO [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 00:03:42,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 00:03:42,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:42,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 00:03:42,078 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:42,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:42,087 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4 empty. 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0 empty. 2023-02-13 00:03:42,088 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5 empty. 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf empty. 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834 empty. 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691 empty. 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,089 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5 empty. 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4 empty. 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707 empty. 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f empty. 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,090 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,091 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,091 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,091 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 00:03:42,107 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:42,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41383a8178f40da3b1b60f5e130b38b4, NAME => 'testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,109 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 43a9c7b974b83e70fc6dd7e193f184f0, NAME => 'testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,109 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9f9ea029dc149ace45c4f4c605a14834, NAME => 'testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 41383a8178f40da3b1b60f5e130b38b4, disabling compactions & flushes 2023-02-13 00:03:42,120 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. after waiting 0 ms 2023-02-13 00:03:42,120 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 41383a8178f40da3b1b60f5e130b38b4: Waiting for close lock at 1676246622120Disabling compacts and flushes for region at 1676246622120Disabling writes for close at 1676246622120Writing region close event to WAL at 1676246622121 (+1 ms)Closed at 1676246622121 2023-02-13 00:03:42,121 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 81253aedf8d8cf083c1faf41738af691, NAME => 'testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9f9ea029dc149ace45c4f4c605a14834, disabling compactions & flushes 2023-02-13 00:03:42,123 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. after waiting 0 ms 2023-02-13 00:03:42,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,123 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9f9ea029dc149ace45c4f4c605a14834: Waiting for close lock at 1676246622123Disabling compacts and flushes for region at 1676246622123Disabling writes for close at 1676246622123Writing region close event to WAL at 1676246622123Closed at 1676246622123 2023-02-13 00:03:42,124 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8135349477b19c3998d47bdb822690b5, NAME => 'testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 43a9c7b974b83e70fc6dd7e193f184f0, disabling compactions & flushes 2023-02-13 00:03:42,125 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. after waiting 0 ms 2023-02-13 00:03:42,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,125 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,125 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 43a9c7b974b83e70fc6dd7e193f184f0: Waiting for close lock at 1676246622125Disabling compacts and flushes for region at 1676246622125Disabling writes for close at 1676246622125Writing region close event to WAL at 1676246622125Closed at 1676246622125 2023-02-13 00:03:42,126 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 762f4c654acaee6df0e96477fa7381c4, NAME => 'testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8135349477b19c3998d47bdb822690b5, disabling compactions & flushes 2023-02-13 00:03:42,136 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. after waiting 0 ms 2023-02-13 00:03:42,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,137 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8135349477b19c3998d47bdb822690b5: Waiting for close lock at 1676246622136Disabling compacts and flushes for region at 1676246622136Disabling writes for close at 1676246622136Writing region close event to WAL at 1676246622137 (+1 ms)Closed at 1676246622137 2023-02-13 00:03:42,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 619db296ff6d7014fd9ca553592788bf, NAME => 'testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 81253aedf8d8cf083c1faf41738af691, disabling compactions & flushes 2023-02-13 00:03:42,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. after waiting 0 ms 2023-02-13 00:03:42,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 81253aedf8d8cf083c1faf41738af691: Waiting for close lock at 1676246622138Disabling compacts and flushes for region at 1676246622138Disabling writes for close at 1676246622138Writing region close event to WAL at 1676246622138Closed at 1676246622138 2023-02-13 00:03:42,139 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 457b1682113ec60e93922fdb95420ad5, NAME => 'testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 762f4c654acaee6df0e96477fa7381c4, disabling compactions & flushes 2023-02-13 00:03:42,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. after waiting 0 ms 2023-02-13 00:03:42,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 762f4c654acaee6df0e96477fa7381c4: Waiting for close lock at 1676246622141Disabling compacts and flushes for region at 1676246622141Disabling writes for close at 1676246622141Writing region close event to WAL at 1676246622141Closed at 1676246622141 2023-02-13 00:03:42,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => baa6c7b62b7e293fa106c12fdd85618f, NAME => 'testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,149 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,149 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 457b1682113ec60e93922fdb95420ad5, disabling compactions & flushes 2023-02-13 00:03:42,149 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,149 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,149 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. after waiting 0 ms 2023-02-13 00:03:42,149 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,149 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,149 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 457b1682113ec60e93922fdb95420ad5: Waiting for close lock at 1676246622149Disabling compacts and flushes for region at 1676246622149Disabling writes for close at 1676246622149Writing region close event to WAL at 1676246622149Closed at 1676246622149 2023-02-13 00:03:42,150 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 85114851d4628826eb63d2a93ef50707, NAME => 'testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.tmp 2023-02-13 00:03:42,151 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,151 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing baa6c7b62b7e293fa106c12fdd85618f, disabling compactions & flushes 2023-02-13 00:03:42,151 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,151 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. after waiting 0 ms 2023-02-13 00:03:42,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,152 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,152 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for baa6c7b62b7e293fa106c12fdd85618f: Waiting for close lock at 1676246622151Disabling compacts and flushes for region at 1676246622151Disabling writes for close at 1676246622152 (+1 ms)Writing region close event to WAL at 1676246622152Closed at 1676246622152 2023-02-13 00:03:42,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 619db296ff6d7014fd9ca553592788bf, disabling compactions & flushes 2023-02-13 00:03:42,153 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. after waiting 0 ms 2023-02-13 00:03:42,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,153 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 619db296ff6d7014fd9ca553592788bf: Waiting for close lock at 1676246622153Disabling compacts and flushes for region at 1676246622153Disabling writes for close at 1676246622153Writing region close event to WAL at 1676246622153Closed at 1676246622153 2023-02-13 00:03:42,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 85114851d4628826eb63d2a93ef50707, disabling compactions & flushes 2023-02-13 00:03:42,158 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. after waiting 0 ms 2023-02-13 00:03:42,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,158 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 85114851d4628826eb63d2a93ef50707: Waiting for close lock at 1676246622158Disabling compacts and flushes for region at 1676246622158Disabling writes for close at 1676246622158Writing region close event to WAL at 1676246622158Closed at 1676246622158 2023-02-13 00:03:42,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:42,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246622163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246622163"}]},"ts":"1676246622163"} 2023-02-13 00:03:42,172 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 00:03:42,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:42,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246622176"}]},"ts":"1676246622176"} 2023-02-13 00:03:42,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 00:03:42,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:42,182 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:42,191 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:42,191 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:42,191 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:42,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=41383a8178f40da3b1b60f5e130b38b4, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=43a9c7b974b83e70fc6dd7e193f184f0, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9f9ea029dc149ace45c4f4c605a14834, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81253aedf8d8cf083c1faf41738af691, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8135349477b19c3998d47bdb822690b5, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=762f4c654acaee6df0e96477fa7381c4, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=619db296ff6d7014fd9ca553592788bf, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=457b1682113ec60e93922fdb95420ad5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=baa6c7b62b7e293fa106c12fdd85618f, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=85114851d4628826eb63d2a93ef50707, ASSIGN}] 2023-02-13 00:03:42,194 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=43a9c7b974b83e70fc6dd7e193f184f0, ASSIGN 2023-02-13 00:03:42,195 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9f9ea029dc149ace45c4f4c605a14834, ASSIGN 2023-02-13 00:03:42,195 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=41383a8178f40da3b1b60f5e130b38b4, ASSIGN 2023-02-13 00:03:42,195 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=81253aedf8d8cf083c1faf41738af691, ASSIGN 2023-02-13 00:03:42,195 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=43a9c7b974b83e70fc6dd7e193f184f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35171,1676246620621; forceNewPlan=false, retain=false 2023-02-13 00:03:42,196 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9f9ea029dc149ace45c4f4c605a14834, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44453,1676246620575; forceNewPlan=false, retain=false 2023-02-13 00:03:42,196 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=41383a8178f40da3b1b60f5e130b38b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35171,1676246620621; forceNewPlan=false, retain=false 2023-02-13 00:03:42,196 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=81253aedf8d8cf083c1faf41738af691, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35171,1676246620621; forceNewPlan=false, retain=false 2023-02-13 00:03:42,197 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=85114851d4628826eb63d2a93ef50707, ASSIGN 2023-02-13 00:03:42,197 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=457b1682113ec60e93922fdb95420ad5, ASSIGN 2023-02-13 00:03:42,197 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=baa6c7b62b7e293fa106c12fdd85618f, ASSIGN 2023-02-13 00:03:42,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=619db296ff6d7014fd9ca553592788bf, ASSIGN 2023-02-13 00:03:42,197 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=762f4c654acaee6df0e96477fa7381c4, ASSIGN 2023-02-13 00:03:42,197 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=85114851d4628826eb63d2a93ef50707, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44453,1676246620575; forceNewPlan=false, retain=false 2023-02-13 00:03:42,197 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=457b1682113ec60e93922fdb95420ad5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35171,1676246620621; forceNewPlan=false, retain=false 2023-02-13 00:03:42,200 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=baa6c7b62b7e293fa106c12fdd85618f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44453,1676246620575; forceNewPlan=false, retain=false 2023-02-13 00:03:42,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=619db296ff6d7014fd9ca553592788bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35171,1676246620621; forceNewPlan=false, retain=false 2023-02-13 00:03:42,200 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=762f4c654acaee6df0e96477fa7381c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44453,1676246620575; forceNewPlan=false, retain=false 2023-02-13 00:03:42,200 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8135349477b19c3998d47bdb822690b5, ASSIGN 2023-02-13 00:03:42,201 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8135349477b19c3998d47bdb822690b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44453,1676246620575; forceNewPlan=false, retain=false 2023-02-13 00:03:42,345 INFO [jenkins-hbase4:44265] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 00:03:42,349 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=762f4c654acaee6df0e96477fa7381c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,349 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=85114851d4628826eb63d2a93ef50707, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,349 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=baa6c7b62b7e293fa106c12fdd85618f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,350 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246622349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622349"}]},"ts":"1676246622349"} 2023-02-13 00:03:42,349 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8135349477b19c3998d47bdb822690b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,349 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9f9ea029dc149ace45c4f4c605a14834, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,350 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622349"}]},"ts":"1676246622349"} 2023-02-13 00:03:42,350 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622349"}]},"ts":"1676246622349"} 2023-02-13 00:03:42,350 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622349"}]},"ts":"1676246622349"} 2023-02-13 00:03:42,350 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622349"}]},"ts":"1676246622349"} 2023-02-13 00:03:42,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 85114851d4628826eb63d2a93ef50707, server=jenkins-hbase4.apache.org,44453,1676246620575}] 2023-02-13 00:03:42,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 9f9ea029dc149ace45c4f4c605a14834, server=jenkins-hbase4.apache.org,44453,1676246620575}] 2023-02-13 00:03:42,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure baa6c7b62b7e293fa106c12fdd85618f, server=jenkins-hbase4.apache.org,44453,1676246620575}] 2023-02-13 00:03:42,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 762f4c654acaee6df0e96477fa7381c4, server=jenkins-hbase4.apache.org,44453,1676246620575}] 2023-02-13 00:03:42,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 8135349477b19c3998d47bdb822690b5, server=jenkins-hbase4.apache.org,44453,1676246620575}] 2023-02-13 00:03:42,360 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=81253aedf8d8cf083c1faf41738af691, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,360 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622360"}]},"ts":"1676246622360"} 2023-02-13 00:03:42,362 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=41383a8178f40da3b1b60f5e130b38b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246622362"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622362"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622362"}]},"ts":"1676246622362"} 2023-02-13 00:03:42,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=14, state=RUNNABLE; OpenRegionProcedure 81253aedf8d8cf083c1faf41738af691, server=jenkins-hbase4.apache.org,35171,1676246620621}] 2023-02-13 00:03:42,365 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=619db296ff6d7014fd9ca553592788bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,365 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622365"}]},"ts":"1676246622365"} 2023-02-13 00:03:42,365 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=43a9c7b974b83e70fc6dd7e193f184f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,366 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622365"}]},"ts":"1676246622365"} 2023-02-13 00:03:42,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 41383a8178f40da3b1b60f5e130b38b4, server=jenkins-hbase4.apache.org,35171,1676246620621}] 2023-02-13 00:03:42,366 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=457b1682113ec60e93922fdb95420ad5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,366 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246622366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246622366"}]},"ts":"1676246622366"} 2023-02-13 00:03:42,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 619db296ff6d7014fd9ca553592788bf, server=jenkins-hbase4.apache.org,35171,1676246620621}] 2023-02-13 00:03:42,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 43a9c7b974b83e70fc6dd7e193f184f0, server=jenkins-hbase4.apache.org,35171,1676246620621}] 2023-02-13 00:03:42,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 457b1682113ec60e93922fdb95420ad5, server=jenkins-hbase4.apache.org,35171,1676246620621}] 2023-02-13 00:03:42,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:42,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9f9ea029dc149ace45c4f4c605a14834, NAME => 'testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 00:03:42,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,512 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,514 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1 2023-02-13 00:03:42,514 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1 2023-02-13 00:03:42,514 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9ea029dc149ace45c4f4c605a14834 columnFamilyName f1 2023-02-13 00:03:42,515 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(310): Store=9f9ea029dc149ace45c4f4c605a14834/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,515 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,516 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2 2023-02-13 00:03:42,516 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2 2023-02-13 00:03:42,517 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9ea029dc149ace45c4f4c605a14834 columnFamilyName f2 2023-02-13 00:03:42,517 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(310): Store=9f9ea029dc149ace45c4f4c605a14834/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43a9c7b974b83e70fc6dd7e193f184f0, NAME => 'testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 00:03:42,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,522 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,526 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1 2023-02-13 00:03:42,526 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1 2023-02-13 00:03:42,526 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43a9c7b974b83e70fc6dd7e193f184f0 columnFamilyName f1 2023-02-13 00:03:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:42,527 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(310): Store=43a9c7b974b83e70fc6dd7e193f184f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,527 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,529 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2 2023-02-13 00:03:42,529 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2 2023-02-13 00:03:42,529 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43a9c7b974b83e70fc6dd7e193f184f0 columnFamilyName f2 2023-02-13 00:03:42,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,530 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(310): Store=43a9c7b974b83e70fc6dd7e193f184f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9f9ea029dc149ace45c4f4c605a14834; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67584477, jitterRate=0.007087185978889465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9f9ea029dc149ace45c4f4c605a14834: Running coprocessor pre-open hook at 1676246622511Writing region info on filesystem at 1676246622511Initializing all the Stores at 1676246622512 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622512Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622512Cleaning up temporary data from old regions at 1676246622519 (+7 ms)Cleaning up detritus from prior splits at 1676246622520 (+1 ms)Running coprocessor post-open hooks at 1676246622530 (+10 ms)Region opened successfully at 1676246622530 2023-02-13 00:03:42,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834., pid=22, masterSystemTime=1676246622506 2023-02-13 00:03:42,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 762f4c654acaee6df0e96477fa7381c4, NAME => 'testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 00:03:42,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,534 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9f9ea029dc149ace45c4f4c605a14834, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,534 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622533"}]},"ts":"1676246622533"} 2023-02-13 00:03:42,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,535 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:42,537 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1 2023-02-13 00:03:42,537 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1 2023-02-13 00:03:42,537 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 762f4c654acaee6df0e96477fa7381c4 columnFamilyName f1 2023-02-13 00:03:42,538 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(310): Store=762f4c654acaee6df0e96477fa7381c4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,538 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-13 00:03:42,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 9f9ea029dc149ace45c4f4c605a14834, server=jenkins-hbase4.apache.org,44453,1676246620575 in 183 msec 2023-02-13 00:03:42,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 43a9c7b974b83e70fc6dd7e193f184f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68192242, jitterRate=0.016143590211868286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 43a9c7b974b83e70fc6dd7e193f184f0: Running coprocessor pre-open hook at 1676246622521Writing region info on filesystem at 1676246622521Initializing all the Stores at 1676246622522 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622522Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622522Cleaning up temporary data from old regions at 1676246622532 (+10 ms)Cleaning up detritus from prior splits at 1676246622533 (+1 ms)Running coprocessor post-open hooks at 1676246622539 (+6 ms)Region opened successfully at 1676246622539 2023-02-13 00:03:42,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9f9ea029dc149ace45c4f4c605a14834, ASSIGN in 346 msec 2023-02-13 00:03:42,540 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2 2023-02-13 00:03:42,540 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2 2023-02-13 00:03:42,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0., pid=29, masterSystemTime=1676246622517 2023-02-13 00:03:42,540 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 762f4c654acaee6df0e96477fa7381c4 columnFamilyName f2 2023-02-13 00:03:42,541 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(310): Store=762f4c654acaee6df0e96477fa7381c4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 619db296ff6d7014fd9ca553592788bf, NAME => 'testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 00:03:42,542 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=43a9c7b974b83e70fc6dd7e193f184f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,542 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622542"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622542"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622542"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622542"}]},"ts":"1676246622542"} 2023-02-13 00:03:42,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:42,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-13 00:03:42,546 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 43a9c7b974b83e70fc6dd7e193f184f0, server=jenkins-hbase4.apache.org,35171,1676246620621 in 176 msec 2023-02-13 00:03:42,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=43a9c7b974b83e70fc6dd7e193f184f0, ASSIGN in 354 msec 2023-02-13 00:03:42,548 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1 2023-02-13 00:03:42,548 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1 2023-02-13 00:03:42,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,549 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619db296ff6d7014fd9ca553592788bf columnFamilyName f1 2023-02-13 00:03:42,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 762f4c654acaee6df0e96477fa7381c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59193372, jitterRate=-0.11795002222061157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 762f4c654acaee6df0e96477fa7381c4: Running coprocessor pre-open hook at 1676246622534Writing region info on filesystem at 1676246622534Initializing all the Stores at 1676246622535 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622535Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622535Cleaning up temporary data from old regions at 1676246622543 (+8 ms)Cleaning up detritus from prior splits at 1676246622543Running coprocessor post-open hooks at 1676246622549 (+6 ms)Region opened successfully at 1676246622549 2023-02-13 00:03:42,549 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(310): Store=619db296ff6d7014fd9ca553592788bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,549 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4., pid=24, masterSystemTime=1676246622506 2023-02-13 00:03:42,551 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2 2023-02-13 00:03:42,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:42,551 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2 2023-02-13 00:03:42,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 85114851d4628826eb63d2a93ef50707, NAME => 'testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 00:03:42,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=762f4c654acaee6df0e96477fa7381c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,551 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619db296ff6d7014fd9ca553592788bf columnFamilyName f2 2023-02-13 00:03:42,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622551"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622551"}]},"ts":"1676246622551"} 2023-02-13 00:03:42,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,552 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(310): Store=619db296ff6d7014fd9ca553592788bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,554 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,555 DEBUG [StoreOpener-85114851d4628826eb63d2a93ef50707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/f1 2023-02-13 00:03:42,555 DEBUG [StoreOpener-85114851d4628826eb63d2a93ef50707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/f1 2023-02-13 00:03:42,555 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85114851d4628826eb63d2a93ef50707 columnFamilyName f1 2023-02-13 00:03:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-13 00:03:42,556 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(310): Store=85114851d4628826eb63d2a93ef50707/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 762f4c654acaee6df0e96477fa7381c4, server=jenkins-hbase4.apache.org,44453,1676246620575 in 198 msec 2023-02-13 00:03:42,556 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=762f4c654acaee6df0e96477fa7381c4, ASSIGN in 364 msec 2023-02-13 00:03:42,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:42,558 DEBUG [StoreOpener-85114851d4628826eb63d2a93ef50707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/f2 2023-02-13 00:03:42,558 DEBUG [StoreOpener-85114851d4628826eb63d2a93ef50707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/f2 2023-02-13 00:03:42,558 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85114851d4628826eb63d2a93ef50707 columnFamilyName f2 2023-02-13 00:03:42,559 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(310): Store=85114851d4628826eb63d2a93ef50707/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 619db296ff6d7014fd9ca553592788bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66906805, jitterRate=-0.0030109137296676636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 619db296ff6d7014fd9ca553592788bf: Running coprocessor pre-open hook at 1676246622543Writing region info on filesystem at 1676246622543Initializing all the Stores at 1676246622544 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622544Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622546 (+2 ms)Cleaning up temporary data from old regions at 1676246622555 (+9 ms)Cleaning up detritus from prior splits at 1676246622555Running coprocessor post-open hooks at 1676246622560 (+5 ms)Region opened successfully at 1676246622560 2023-02-13 00:03:42,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf., pid=28, masterSystemTime=1676246622517 2023-02-13 00:03:42,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:42,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 457b1682113ec60e93922fdb95420ad5, NAME => 'testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 00:03:42,563 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=619db296ff6d7014fd9ca553592788bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:42,563 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622563"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622563"}]},"ts":"1676246622563"} 2023-02-13 00:03:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,564 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 85114851d4628826eb63d2a93ef50707; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71880104, jitterRate=0.07109701633453369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 85114851d4628826eb63d2a93ef50707: Running coprocessor pre-open hook at 1676246622552Writing region info on filesystem at 1676246622552Initializing all the Stores at 1676246622553 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622553Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622553Cleaning up temporary data from old regions at 1676246622560 (+7 ms)Cleaning up detritus from prior splits at 1676246622561 (+1 ms)Running coprocessor post-open hooks at 1676246622566 (+5 ms)Region opened successfully at 1676246622566 2023-02-13 00:03:42,566 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1 2023-02-13 00:03:42,566 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1 2023-02-13 00:03:42,566 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 457b1682113ec60e93922fdb95420ad5 columnFamilyName f1 2023-02-13 00:03:42,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707., pid=21, masterSystemTime=1676246622506 2023-02-13 00:03:42,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-13 00:03:42,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 619db296ff6d7014fd9ca553592788bf, server=jenkins-hbase4.apache.org,35171,1676246620621 in 198 msec 2023-02-13 00:03:42,567 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(310): Store=457b1682113ec60e93922fdb95420ad5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,567 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=619db296ff6d7014fd9ca553592788bf, ASSIGN in 375 msec 2023-02-13 00:03:42,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:42,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8135349477b19c3998d47bdb822690b5, NAME => 'testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 00:03:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,569 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=85114851d4628826eb63d2a93ef50707, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,569 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246622569"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622569"}]},"ts":"1676246622569"} 2023-02-13 00:03:42,570 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2 2023-02-13 00:03:42,570 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2 2023-02-13 00:03:42,570 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,570 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 457b1682113ec60e93922fdb95420ad5 columnFamilyName f2 2023-02-13 00:03:42,571 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(310): Store=457b1682113ec60e93922fdb95420ad5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,572 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1 2023-02-13 00:03:42,572 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1 2023-02-13 00:03:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,573 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8135349477b19c3998d47bdb822690b5 columnFamilyName f1 2023-02-13 00:03:42,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 00:03:42,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 85114851d4628826eb63d2a93ef50707, server=jenkins-hbase4.apache.org,44453,1676246620575 in 219 msec 2023-02-13 00:03:42,574 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(310): Store=8135349477b19c3998d47bdb822690b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,574 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=85114851d4628826eb63d2a93ef50707, ASSIGN in 381 msec 2023-02-13 00:03:42,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,575 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2 2023-02-13 00:03:42,575 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2 2023-02-13 00:03:42,576 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8135349477b19c3998d47bdb822690b5 columnFamilyName f2 2023-02-13 00:03:42,576 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(310): Store=8135349477b19c3998d47bdb822690b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:42,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 457b1682113ec60e93922fdb95420ad5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74343195, jitterRate=0.10779993236064911}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 457b1682113ec60e93922fdb95420ad5: Running coprocessor pre-open hook at 1676246622563Writing region info on filesystem at 1676246622563Initializing all the Stores at 1676246622564 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622564Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622564Cleaning up temporary data from old regions at 1676246622574 (+10 ms)Cleaning up detritus from prior splits at 1676246622574Running coprocessor post-open hooks at 1676246622579 (+5 ms)Region opened successfully at 1676246622579 2023-02-13 00:03:42,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5., pid=30, masterSystemTime=1676246622517 2023-02-13 00:03:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:42,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 81253aedf8d8cf083c1faf41738af691, NAME => 'testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 00:03:42,582 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=457b1682113ec60e93922fdb95420ad5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622582"}]},"ts":"1676246622582"} 2023-02-13 00:03:42,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:42,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-13 00:03:42,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 457b1682113ec60e93922fdb95420ad5, server=jenkins-hbase4.apache.org,35171,1676246620621 in 215 msec 2023-02-13 00:03:42,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=457b1682113ec60e93922fdb95420ad5, ASSIGN in 394 msec 2023-02-13 00:03:42,588 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,601 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1 2023-02-13 00:03:42,601 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1 2023-02-13 00:03:42,602 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81253aedf8d8cf083c1faf41738af691 columnFamilyName f1 2023-02-13 00:03:42,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8135349477b19c3998d47bdb822690b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69600551, jitterRate=0.037129029631614685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8135349477b19c3998d47bdb822690b5: Running coprocessor pre-open hook at 1676246622569Writing region info on filesystem at 1676246622569Initializing all the Stores at 1676246622570 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622570Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622570Cleaning up temporary data from old regions at 1676246622578 (+8 ms)Cleaning up detritus from prior splits at 1676246622579 (+1 ms)Running coprocessor post-open hooks at 1676246622603 (+24 ms)Region opened successfully at 1676246622603 2023-02-13 00:03:42,603 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(310): Store=81253aedf8d8cf083c1faf41738af691/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,603 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5., pid=25, masterSystemTime=1676246622506 2023-02-13 00:03:42,605 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2 2023-02-13 00:03:42,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,606 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2 2023-02-13 00:03:42,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:42,606 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8135349477b19c3998d47bdb822690b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,606 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622606"}]},"ts":"1676246622606"} 2023-02-13 00:03:42,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => baa6c7b62b7e293fa106c12fdd85618f, NAME => 'testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 00:03:42,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,606 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81253aedf8d8cf083c1faf41738af691 columnFamilyName f2 2023-02-13 00:03:42,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-13 00:03:42,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 8135349477b19c3998d47bdb822690b5, server=jenkins-hbase4.apache.org,44453,1676246620575 in 255 msec 2023-02-13 00:03:42,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8135349477b19c3998d47bdb822690b5, ASSIGN in 422 msec 2023-02-13 00:03:42,620 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(310): Store=81253aedf8d8cf083c1faf41738af691/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,620 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,622 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1 2023-02-13 00:03:42,622 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1 2023-02-13 00:03:42,622 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region baa6c7b62b7e293fa106c12fdd85618f columnFamilyName f1 2023-02-13 00:03:42,623 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(310): Store=baa6c7b62b7e293fa106c12fdd85618f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,623 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,625 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2 2023-02-13 00:03:42,625 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2 2023-02-13 00:03:42,625 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region baa6c7b62b7e293fa106c12fdd85618f columnFamilyName f2 2023-02-13 00:03:42,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:42,626 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(310): Store=baa6c7b62b7e293fa106c12fdd85618f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 81253aedf8d8cf083c1faf41738af691; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70450853, jitterRate=0.049799516797065735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 81253aedf8d8cf083c1faf41738af691: Running coprocessor pre-open hook at 1676246622583Writing region info on filesystem at 1676246622583Initializing all the Stores at 1676246622584 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622584Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622588 (+4 ms)Cleaning up temporary data from old regions at 1676246622622 (+34 ms)Cleaning up detritus from prior splits at 1676246622623 (+1 ms)Running coprocessor post-open hooks at 1676246622629 (+6 ms)Region opened successfully at 1676246622629 2023-02-13 00:03:42,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691., pid=26, masterSystemTime=1676246622517 2023-02-13 00:03:42,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:42,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:42,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41383a8178f40da3b1b60f5e130b38b4, NAME => 'testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 00:03:42,633 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=81253aedf8d8cf083c1faf41738af691, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,633 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622632"}]},"ts":"1676246622632"} 2023-02-13 00:03:42,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:42,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,635 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened baa6c7b62b7e293fa106c12fdd85618f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75326070, jitterRate=0.12244591116905212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for baa6c7b62b7e293fa106c12fdd85618f: Running coprocessor pre-open hook at 1676246622607Writing region info on filesystem at 1676246622607Initializing all the Stores at 1676246622610 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622610Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622620 (+10 ms)Cleaning up temporary data from old regions at 1676246622628 (+8 ms)Cleaning up detritus from prior splits at 1676246622628Running coprocessor post-open hooks at 1676246622635 (+7 ms)Region opened successfully at 1676246622635 2023-02-13 00:03:42,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f., pid=23, masterSystemTime=1676246622506 2023-02-13 00:03:42,636 DEBUG [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/f1 2023-02-13 00:03:42,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=14 2023-02-13 00:03:42,636 DEBUG [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/f1 2023-02-13 00:03:42,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=14, state=SUCCESS; OpenRegionProcedure 81253aedf8d8cf083c1faf41738af691, server=jenkins-hbase4.apache.org,35171,1676246620621 in 271 msec 2023-02-13 00:03:42,637 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41383a8178f40da3b1b60f5e130b38b4 columnFamilyName f1 2023-02-13 00:03:42,638 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(310): Store=41383a8178f40da3b1b60f5e130b38b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,638 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=81253aedf8d8cf083c1faf41738af691, ASSIGN in 445 msec 2023-02-13 00:03:42,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:42,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=baa6c7b62b7e293fa106c12fdd85618f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:42,639 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676246622638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622638"}]},"ts":"1676246622638"} 2023-02-13 00:03:42,640 DEBUG [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/f2 2023-02-13 00:03:42,640 DEBUG [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/f2 2023-02-13 00:03:42,641 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41383a8178f40da3b1b60f5e130b38b4 columnFamilyName f2 2023-02-13 00:03:42,641 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(310): Store=41383a8178f40da3b1b60f5e130b38b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:42,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-13 00:03:42,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure baa6c7b62b7e293fa106c12fdd85618f, server=jenkins-hbase4.apache.org,44453,1676246620575 in 286 msec 2023-02-13 00:03:42,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=baa6c7b62b7e293fa106c12fdd85618f, ASSIGN in 450 msec 2023-02-13 00:03:42,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:42,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:42,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:42,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41383a8178f40da3b1b60f5e130b38b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64426098, jitterRate=-0.0399763286113739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:42,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41383a8178f40da3b1b60f5e130b38b4: Running coprocessor pre-open hook at 1676246622633Writing region info on filesystem at 1676246622633Initializing all the Stores at 1676246622634 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622634Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246622634Cleaning up temporary data from old regions at 1676246622647 (+13 ms)Cleaning up detritus from prior splits at 1676246622648 (+1 ms)Running coprocessor post-open hooks at 1676246622653 (+5 ms)Region opened successfully at 1676246622653 2023-02-13 00:03:42,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4., pid=27, masterSystemTime=1676246622517 2023-02-13 00:03:42,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:42,656 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=41383a8178f40da3b1b60f5e130b38b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:42,656 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676246622656"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246622656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246622656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246622656"}]},"ts":"1676246622656"} 2023-02-13 00:03:42,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-13 00:03:42,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 41383a8178f40da3b1b60f5e130b38b4, server=jenkins-hbase4.apache.org,35171,1676246620621 in 292 msec 2023-02-13 00:03:42,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 00:03:42,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=41383a8178f40da3b1b60f5e130b38b4, ASSIGN in 467 msec 2023-02-13 00:03:42,662 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:42,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246622662"}]},"ts":"1676246622662"} 2023-02-13 00:03:42,663 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 00:03:42,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:42,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 593 msec 2023-02-13 00:03:42,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:42,683 INFO [Listener at localhost/38137] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 00:03:42,683 DEBUG [Listener at localhost/38137] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 00:03:42,684 INFO [Listener at localhost/38137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:42,687 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 00:03:42,687 INFO [Listener at localhost/38137] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:42,687 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 00:03:42,687 INFO [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:03:42,754 DEBUG [hconnection-0x79128360-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:42,777 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60562, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:42,785 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35171] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:42,790 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44453] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:42,912 INFO [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:03:42,912 INFO [Listener at localhost/38137] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:03:42,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:03:42,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246622914 (current time:1676246622914). 2023-02-13 00:03:42,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:03:42,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] zookeeper.ReadOnlyZKClient(139): Connect 0x3a3ae7d3 to 127.0.0.1:60508 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:42,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33a4bcdc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:42,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:42,927 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:42,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a3ae7d3 to 127.0.0.1:60508 2023-02-13 00:03:42,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:42,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:03:42,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:03:42,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:03:42,933 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:03:42,934 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676247222934 2023-02-13 00:03:42,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:03:42,946 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:42,947 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:03:42,956 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 00:03:42,957 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:03:42,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:03:42,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 27 msec 2023-02-13 00:03:42,960 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:03:42,960 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676247222960 2023-02-13 00:03:43,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,024 INFO [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-13 00:03:43,024 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:43,025 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-13 00:03:43,025 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-13 00:03:43,026 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,026 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,027 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:43,027 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:43,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:43,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:43,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:43,027 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,028 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,028 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 00:03:43,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 00:03:43,029 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,029 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:43,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,033 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 00:03:43,033 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:43,033 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 00:03:43,034 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:43,034 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 00:03:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 00:03:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 00:03:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 00:03:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35171,1676246620621' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 00:03:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44453,1676246620575' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 00:03:43,036 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:43,036 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:43,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35171,1676246620621' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 00:03:43,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a037696[Count = 1] remaining members to acquire global barrier 2023-02-13 00:03:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:43,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:43,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:43,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:43,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44453,1676246620575' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 00:03:43,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a037696[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:43,042 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-13 00:03:43,042 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,043 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,043 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,044 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,044 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:43,044 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:43,044 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:43,044 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,044 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:43,044 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. started... 2023-02-13 00:03:43,044 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,044 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:43,047 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:43,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:43,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:43,048 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:03:43,053 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 43a9c7b974b83e70fc6dd7e193f184f0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 00:03:43,053 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 00:03:43,053 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:43,053 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. started... 2023-02-13 00:03:43,053 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:43,062 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. started... 2023-02-13 00:03:43,062 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:43,064 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. started... 2023-02-13 00:03:43,064 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:43,062 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 00:03:43,065 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:43,054 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 762f4c654acaee6df0e96477fa7381c4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:43,053 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:43,068 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. started... 2023-02-13 00:03:43,065 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. started... 2023-02-13 00:03:43,069 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 457b1682113ec60e93922fdb95420ad5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:43,064 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8135349477b19c3998d47bdb822690b5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:43,064 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 619db296ff6d7014fd9ca553592788bf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:43,070 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HRegion(2744): Flushing baa6c7b62b7e293fa106c12fdd85618f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 00:03:43,112 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f1/91dce44790824653a7cb57ddca6c29da 2023-02-13 00:03:43,188 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f1/0f74c1b310e14db6a4d9103cc0556f46 2023-02-13 00:03:43,214 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f1/e977aee72ba54d579aae69edbf4ea89d 2023-02-13 00:03:43,219 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f1/ac95ef5616d44f5fb510d9b6e9f40493 2023-02-13 00:03:43,245 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f2/24be38a1264547b9a25dc0a6e887070e 2023-02-13 00:03:43,248 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:43,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:43,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:43,250 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 00:03:43,252 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 00:03:43,252 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f1/8a3cbc16b2a44d0ba98e4ccc64686964 2023-02-13 00:03:43,256 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f2/e17cb8023aa24abaa0c979528bd25d50 2023-02-13 00:03:43,262 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f1/91dce44790824653a7cb57ddca6c29da as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/91dce44790824653a7cb57ddca6c29da 2023-02-13 00:03:43,265 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f1/0f74c1b310e14db6a4d9103cc0556f46 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/0f74c1b310e14db6a4d9103cc0556f46 2023-02-13 00:03:43,268 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/91dce44790824653a7cb57ddca6c29da, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:43,270 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f2/24be38a1264547b9a25dc0a6e887070e as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/24be38a1264547b9a25dc0a6e887070e 2023-02-13 00:03:43,272 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/0f74c1b310e14db6a4d9103cc0556f46, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,273 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f2/e17cb8023aa24abaa0c979528bd25d50 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/e17cb8023aa24abaa0c979528bd25d50 2023-02-13 00:03:43,288 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/e17cb8023aa24abaa0c979528bd25d50, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,289 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/24be38a1264547b9a25dc0a6e887070e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:43,289 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8135349477b19c3998d47bdb822690b5 in 225ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,289 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 00:03:43,290 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 43a9c7b974b83e70fc6dd7e193f184f0 in 237ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,290 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8135349477b19c3998d47bdb822690b5: 2023-02-13 00:03:43,290 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,290 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,291 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/0f74c1b310e14db6a4d9103cc0556f46] hfiles 2023-02-13 00:03:43,291 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/0f74c1b310e14db6a4d9103cc0556f46 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,291 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/e17cb8023aa24abaa0c979528bd25d50] hfiles 2023-02-13 00:03:43,291 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/e17cb8023aa24abaa0c979528bd25d50 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,304 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 43a9c7b974b83e70fc6dd7e193f184f0: 2023-02-13 00:03:43,304 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,304 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,304 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/91dce44790824653a7cb57ddca6c29da] hfiles 2023-02-13 00:03:43,304 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/91dce44790824653a7cb57ddca6c29da for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,305 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/24be38a1264547b9a25dc0a6e887070e] hfiles 2023-02-13 00:03:43,305 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/24be38a1264547b9a25dc0a6e887070e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,340 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f2/e3aa879b84a548de9c52f45a2d80585b 2023-02-13 00:03:43,361 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f2/e9b90870e1274910aafbca487a730bb2 2023-02-13 00:03:43,365 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f1/e977aee72ba54d579aae69edbf4ea89d as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/e977aee72ba54d579aae69edbf4ea89d 2023-02-13 00:03:43,369 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f1/ac95ef5616d44f5fb510d9b6e9f40493 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/ac95ef5616d44f5fb510d9b6e9f40493 2023-02-13 00:03:43,371 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/e977aee72ba54d579aae69edbf4ea89d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,410 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f2/ee05464773d74ac4a5ff0fee4c07b8cf 2023-02-13 00:03:43,412 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f2/e3aa879b84a548de9c52f45a2d80585b as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/e3aa879b84a548de9c52f45a2d80585b 2023-02-13 00:03:43,419 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/ac95ef5616d44f5fb510d9b6e9f40493, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,421 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f2/e9b90870e1274910aafbca487a730bb2 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/e9b90870e1274910aafbca487a730bb2 2023-02-13 00:03:43,421 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/e3aa879b84a548de9c52f45a2d80585b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,422 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f1/8a3cbc16b2a44d0ba98e4ccc64686964 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/8a3cbc16b2a44d0ba98e4ccc64686964 2023-02-13 00:03:43,423 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 457b1682113ec60e93922fdb95420ad5 in 354ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 457b1682113ec60e93922fdb95420ad5: 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/e977aee72ba54d579aae69edbf4ea89d] hfiles 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/e977aee72ba54d579aae69edbf4ea89d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/e3aa879b84a548de9c52f45a2d80585b] hfiles 2023-02-13 00:03:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/e3aa879b84a548de9c52f45a2d80585b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,436 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. completed. 2023-02-13 00:03:43,436 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:43,436 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:43,436 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 00:03:43,436 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. started... 2023-02-13 00:03:43,437 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. completed. 2023-02-13 00:03:43,443 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 81253aedf8d8cf083c1faf41738af691 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:43,450 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:43,450 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:43,450 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. started... 2023-02-13 00:03:43,451 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9f9ea029dc149ace45c4f4c605a14834 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:43,450 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 00:03:43,453 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/8a3cbc16b2a44d0ba98e4ccc64686964, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:43,457 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/e9b90870e1274910aafbca487a730bb2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,458 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 619db296ff6d7014fd9ca553592788bf in 394ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,458 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 619db296ff6d7014fd9ca553592788bf: 2023-02-13 00:03:43,458 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,458 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,459 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/ac95ef5616d44f5fb510d9b6e9f40493] hfiles 2023-02-13 00:03:43,459 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/ac95ef5616d44f5fb510d9b6e9f40493 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,459 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/e9b90870e1274910aafbca487a730bb2] hfiles 2023-02-13 00:03:43,459 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/e9b90870e1274910aafbca487a730bb2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,507 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f2/ee05464773d74ac4a5ff0fee4c07b8cf as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/ee05464773d74ac4a5ff0fee4c07b8cf 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. completed. 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:43,516 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. started... 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 41383a8178f40da3b1b60f5e130b38b4: 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,516 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:43,517 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:43,537 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/ee05464773d74ac4a5ff0fee4c07b8cf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:43,538 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for baa6c7b62b7e293fa106c12fdd85618f in 468ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,538 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for baa6c7b62b7e293fa106c12fdd85618f: 2023-02-13 00:03:43,538 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,538 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,538 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/8a3cbc16b2a44d0ba98e4ccc64686964] hfiles 2023-02-13 00:03:43,538 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/8a3cbc16b2a44d0ba98e4ccc64686964 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,538 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/ee05464773d74ac4a5ff0fee4c07b8cf] hfiles 2023-02-13 00:03:43,539 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/ee05464773d74ac4a5ff0fee4c07b8cf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,551 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:43,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:43,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:43,574 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 00:03:43,577 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. completed. 2023-02-13 00:03:43,577 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:43,577 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 00:03:43,588 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f1/8f2e687df7054f8bbd7aea8606360712 2023-02-13 00:03:43,588 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. completed. 2023-02-13 00:03:43,588 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. completed. 2023-02-13 00:03:43,588 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:43,588 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:43,588 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 00:03:43,588 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. started... 2023-02-13 00:03:43,589 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 85114851d4628826eb63d2a93ef50707: 2023-02-13 00:03:43,589 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f1/87f9560224644cbd905ad282d80ec21d 2023-02-13 00:03:43,589 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,589 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,589 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 00:03:43,589 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:43,596 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f1/f189bb34596b4cfaa7fe54267c5ff537 2023-02-13 00:03:43,620 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. completed. 2023-02-13 00:03:43,620 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:43,620 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 00:03:43,647 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f2/1ae2a90ca3934ffc935b197a91a5f165 2023-02-13 00:03:43,652 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f2/a9a8f7724dcb41c1ae838078a239e6e8 2023-02-13 00:03:43,654 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f1/8f2e687df7054f8bbd7aea8606360712 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/8f2e687df7054f8bbd7aea8606360712 2023-02-13 00:03:43,657 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f2/e8f88d232f81453184d642f135db3645 2023-02-13 00:03:43,660 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f1/87f9560224644cbd905ad282d80ec21d as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/87f9560224644cbd905ad282d80ec21d 2023-02-13 00:03:43,661 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/8f2e687df7054f8bbd7aea8606360712, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,662 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f2/1ae2a90ca3934ffc935b197a91a5f165 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/1ae2a90ca3934ffc935b197a91a5f165 2023-02-13 00:03:43,666 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f1/f189bb34596b4cfaa7fe54267c5ff537 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/f189bb34596b4cfaa7fe54267c5ff537 2023-02-13 00:03:43,668 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/87f9560224644cbd905ad282d80ec21d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,669 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f2/a9a8f7724dcb41c1ae838078a239e6e8 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/a9a8f7724dcb41c1ae838078a239e6e8 2023-02-13 00:03:43,672 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/1ae2a90ca3934ffc935b197a91a5f165, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,673 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 762f4c654acaee6df0e96477fa7381c4 in 619ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,673 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/f189bb34596b4cfaa7fe54267c5ff537, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,673 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 762f4c654acaee6df0e96477fa7381c4: 2023-02-13 00:03:43,674 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,674 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,674 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/8f2e687df7054f8bbd7aea8606360712] hfiles 2023-02-13 00:03:43,674 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/8f2e687df7054f8bbd7aea8606360712 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,674 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/1ae2a90ca3934ffc935b197a91a5f165] hfiles 2023-02-13 00:03:43,674 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/1ae2a90ca3934ffc935b197a91a5f165 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,675 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f2/e8f88d232f81453184d642f135db3645 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/e8f88d232f81453184d642f135db3645 2023-02-13 00:03:43,676 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/a9a8f7724dcb41c1ae838078a239e6e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,677 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 81253aedf8d8cf083c1faf41738af691 in 235ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 81253aedf8d8cf083c1faf41738af691: 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/87f9560224644cbd905ad282d80ec21d] hfiles 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/87f9560224644cbd905ad282d80ec21d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/a9a8f7724dcb41c1ae838078a239e6e8] hfiles 2023-02-13 00:03:43,677 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/a9a8f7724dcb41c1ae838078a239e6e8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,694 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/e8f88d232f81453184d642f135db3645, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:43,695 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9f9ea029dc149ace45c4f4c605a14834 in 244ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9f9ea029dc149ace45c4f4c605a14834: 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/f189bb34596b4cfaa7fe54267c5ff537] hfiles 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/f189bb34596b4cfaa7fe54267c5ff537 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/e8f88d232f81453184d642f135db3645] hfiles 2023-02-13 00:03:43,695 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/e8f88d232f81453184d642f135db3645 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,712 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. completed. 2023-02-13 00:03:43,712 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:43,712 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 00:03:43,727 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. completed. 2023-02-13 00:03:43,727 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:43,727 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 00:03:43,727 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 00:03:43,727 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,728 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 00:03:43,728 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35171,1676246620621' in zk 2023-02-13 00:03:43,730 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. completed. 2023-02-13 00:03:43,730 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:43,730 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 00:03:43,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:43,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:43,730 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 00:03:43,737 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,44453,1676246620575' in zk 2023-02-13 00:03:43,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:43,738 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 00:03:43,738 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:43,739 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:43,739 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 00:03:43,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:43,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35171,1676246620621': 2023-02-13 00:03:43,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35171,1676246620621' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 00:03:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:43,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:43,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,44453,1676246620575': 2023-02-13 00:03:43,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44453,1676246620575' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 00:03:43,747 INFO [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-13 00:03:43,747 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:43,747 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:43,747 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,747 INFO [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:03:43,749 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:43,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:43,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,749 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:43,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:43,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,750 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:43,750 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:43,752 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,753 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,764 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:43,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:43,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,764 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:43,765 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:43,765 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:43,765 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:43,765 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,766 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:43,766 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,766 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:43,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:43,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-13 00:03:43,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,819 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:43,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676246622956Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676246623765 (+809 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676246623765Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676246623774 (+9 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676246623785 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676246623818 (+33 ms) 2023-02-13 00:03:43,820 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:03:43,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 863 msec 2023-02-13 00:03:44,074 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:44,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:03:44,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:03:44,076 INFO [Listener at localhost/38137] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:03:44,081 INFO [Listener at localhost/38137] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:03:44,090 INFO [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:03:44,142 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35171] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:44,151 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44453] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:44,311 INFO [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:03:44,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:03:44,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 00:03:44,321 INFO [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 00:03:44,321 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:44,325 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 00:03:44,325 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 00:03:44,326 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:44,326 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:44,327 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:44,327 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:44,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:44,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:44,327 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:44,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:44,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:44,328 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:44,328 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:44,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:44,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:44,328 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:44,329 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 00:03:44,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 00:03:44,332 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 00:03:44,332 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 00:03:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 00:03:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:44,334 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:44,334 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. started... 2023-02-13 00:03:44,334 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 762f4c654acaee6df0e96477fa7381c4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:44,337 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 00:03:44,337 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:44,337 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. started... 2023-02-13 00:03:44,337 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8135349477b19c3998d47bdb822690b5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:44,340 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 00:03:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:44,341 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:44,341 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. started... 2023-02-13 00:03:44,341 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing baa6c7b62b7e293fa106c12fdd85618f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 00:03:44,342 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:44,342 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. started... 2023-02-13 00:03:44,342 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43a9c7b974b83e70fc6dd7e193f184f0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 00:03:44,344 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:44,344 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. started... 2023-02-13 00:03:44,344 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 619db296ff6d7014fd9ca553592788bf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:44,348 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 00:03:44,352 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:44,352 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:44,352 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. started... 2023-02-13 00:03:44,352 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 457b1682113ec60e93922fdb95420ad5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:44,402 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f1/d36870e9e6db42a0851a9f76585c109f 2023-02-13 00:03:44,409 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f1/c648370717384ad9a1ce31616552e738 2023-02-13 00:03:44,410 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f1/5a1c4a8aafeb43b4acf357a55ba2d3a7 2023-02-13 00:03:44,658 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f1/7120c70b7b504abc99e6ce35f7b275e6 2023-02-13 00:03:44,661 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f1/ce38ef5b1fc44636b33af8ebd3370d74 2023-02-13 00:03:44,732 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f1/7fa45a7d20bd4e49bac9460f2703c82f 2023-02-13 00:03:44,763 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f2/b6d11051c1fa427a8082b33659206ce5 2023-02-13 00:03:44,770 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f1/d36870e9e6db42a0851a9f76585c109f as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/d36870e9e6db42a0851a9f76585c109f 2023-02-13 00:03:44,775 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/d36870e9e6db42a0851a9f76585c109f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,776 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/.tmp/f2/b6d11051c1fa427a8082b33659206ce5 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/b6d11051c1fa427a8082b33659206ce5 2023-02-13 00:03:44,781 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/b6d11051c1fa427a8082b33659206ce5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,782 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 762f4c654acaee6df0e96477fa7381c4 in 448ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:44,782 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 762f4c654acaee6df0e96477fa7381c4: 2023-02-13 00:03:44,782 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:44,784 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 00:03:44,784 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:44,784 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. started... 2023-02-13 00:03:44,784 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9f9ea029dc149ace45c4f4c605a14834 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:44,794 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f2/13a8ee8414374837bf9a4cb7d5831b2d 2023-02-13 00:03:44,799 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f2/a40129114c9241ab91ae5c2f03be1879 2023-02-13 00:03:44,800 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f2/fe67211a4a5a45af9ae98d134a78a770 2023-02-13 00:03:44,801 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f1/7120c70b7b504abc99e6ce35f7b275e6 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/7120c70b7b504abc99e6ce35f7b275e6 2023-02-13 00:03:44,808 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f1/5a1c4a8aafeb43b4acf357a55ba2d3a7 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/5a1c4a8aafeb43b4acf357a55ba2d3a7 2023-02-13 00:03:44,812 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f1/c648370717384ad9a1ce31616552e738 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/c648370717384ad9a1ce31616552e738 2023-02-13 00:03:44,817 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/5a1c4a8aafeb43b4acf357a55ba2d3a7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/.tmp/f2/a40129114c9241ab91ae5c2f03be1879 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/a40129114c9241ab91ae5c2f03be1879 2023-02-13 00:03:44,829 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f2/ac7f28e1a78240e89c2359f62cf0b078 2023-02-13 00:03:44,833 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f1/4372047fa79d485a8f827b976e7501b8 2023-02-13 00:03:44,833 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/a40129114c9241ab91ae5c2f03be1879, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:44,834 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/7120c70b7b504abc99e6ce35f7b275e6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,834 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for baa6c7b62b7e293fa106c12fdd85618f in 493ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:44,834 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for baa6c7b62b7e293fa106c12fdd85618f: 2023-02-13 00:03:44,835 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:44,835 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:44,835 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. started... 2023-02-13 00:03:44,835 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 85114851d4628826eb63d2a93ef50707: 2023-02-13 00:03:44,835 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:44,835 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 00:03:44,835 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 00:03:44,835 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/c648370717384ad9a1ce31616552e738, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,836 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/.tmp/f2/13a8ee8414374837bf9a4cb7d5831b2d as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/13a8ee8414374837bf9a4cb7d5831b2d 2023-02-13 00:03:44,837 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/.tmp/f2/fe67211a4a5a45af9ae98d134a78a770 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/fe67211a4a5a45af9ae98d134a78a770 2023-02-13 00:03:44,846 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f1/7fa45a7d20bd4e49bac9460f2703c82f as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/7fa45a7d20bd4e49bac9460f2703c82f 2023-02-13 00:03:44,848 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/fe67211a4a5a45af9ae98d134a78a770, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,849 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8135349477b19c3998d47bdb822690b5 in 512ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:44,849 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8135349477b19c3998d47bdb822690b5: 2023-02-13 00:03:44,849 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:44,849 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 00:03:44,850 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/13a8ee8414374837bf9a4cb7d5831b2d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,851 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 619db296ff6d7014fd9ca553592788bf in 507ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:44,851 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 619db296ff6d7014fd9ca553592788bf: 2023-02-13 00:03:44,851 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:44,852 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:44,852 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. started... 2023-02-13 00:03:44,852 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 81253aedf8d8cf083c1faf41738af691 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:44,853 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 00:03:44,854 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/7fa45a7d20bd4e49bac9460f2703c82f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,856 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/.tmp/f2/ac7f28e1a78240e89c2359f62cf0b078 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/ac7f28e1a78240e89c2359f62cf0b078 2023-02-13 00:03:44,862 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/ac7f28e1a78240e89c2359f62cf0b078, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,863 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 457b1682113ec60e93922fdb95420ad5 in 511ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:44,863 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 457b1682113ec60e93922fdb95420ad5: 2023-02-13 00:03:44,863 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:44,864 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:44,864 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 00:03:44,864 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. started... 2023-02-13 00:03:44,864 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41383a8178f40da3b1b60f5e130b38b4: 2023-02-13 00:03:44,864 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:44,864 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 00:03:44,874 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f2/c226f8567b3c498c8affadefde8e5251 2023-02-13 00:03:44,880 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f1/f8bd621da3e940ecb8d1e4c9743ef60a 2023-02-13 00:03:44,882 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f1/4372047fa79d485a8f827b976e7501b8 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/4372047fa79d485a8f827b976e7501b8 2023-02-13 00:03:44,892 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/4372047fa79d485a8f827b976e7501b8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,893 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/.tmp/f2/c226f8567b3c498c8affadefde8e5251 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/c226f8567b3c498c8affadefde8e5251 2023-02-13 00:03:44,899 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/c226f8567b3c498c8affadefde8e5251, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:44,900 INFO [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9f9ea029dc149ace45c4f4c605a14834 in 116ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:44,901 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9f9ea029dc149ace45c4f4c605a14834: 2023-02-13 00:03:44,901 DEBUG [rs(jenkins-hbase4.apache.org,44453,1676246620575)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:44,901 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 00:03:44,901 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 00:03:44,901 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 00:03:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44453,1676246620575' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 00:03:44,910 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:44,911 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:44,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:44,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44453,1676246620575' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 00:03:44,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e3cfd0e[Count = 1] remaining members to acquire global barrier 2023-02-13 00:03:45,164 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f2/31a92f327c98454f93c267eb6306e409 2023-02-13 00:03:45,170 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f1/ce38ef5b1fc44636b33af8ebd3370d74 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/ce38ef5b1fc44636b33af8ebd3370d74 2023-02-13 00:03:45,175 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/ce38ef5b1fc44636b33af8ebd3370d74, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:45,176 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/.tmp/f2/31a92f327c98454f93c267eb6306e409 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/31a92f327c98454f93c267eb6306e409 2023-02-13 00:03:45,181 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/31a92f327c98454f93c267eb6306e409, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:45,182 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 43a9c7b974b83e70fc6dd7e193f184f0 in 840ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:45,182 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43a9c7b974b83e70fc6dd7e193f184f0: 2023-02-13 00:03:45,182 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:45,182 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 00:03:45,313 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f2/ac33d0a8de0c4578aaf31f566def0c15 2023-02-13 00:03:45,319 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f1/f8bd621da3e940ecb8d1e4c9743ef60a as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/f8bd621da3e940ecb8d1e4c9743ef60a 2023-02-13 00:03:45,323 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/f8bd621da3e940ecb8d1e4c9743ef60a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:45,324 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/.tmp/f2/ac33d0a8de0c4578aaf31f566def0c15 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/ac33d0a8de0c4578aaf31f566def0c15 2023-02-13 00:03:45,329 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/ac33d0a8de0c4578aaf31f566def0c15, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:45,330 INFO [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 81253aedf8d8cf083c1faf41738af691 in 478ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:45,330 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 81253aedf8d8cf083c1faf41738af691: 2023-02-13 00:03:45,330 DEBUG [rs(jenkins-hbase4.apache.org,35171,1676246620621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 00:03:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 00:03:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 00:03:45,330 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35171,1676246620621' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 00:03:45,332 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:45,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35171,1676246620621' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 00:03:45,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e3cfd0e[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:45,334 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 00:03:45,334 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 00:03:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 00:03:45,336 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35171,1676246620621' in zk 2023-02-13 00:03:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 00:03:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 00:03:45,336 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44453,1676246620575' in zk 2023-02-13 00:03:45,336 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,337 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 00:03:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:45,338 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,338 DEBUG [member: 'jenkins-hbase4.apache.org,35171,1676246620621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 00:03:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 00:03:45,339 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:45,339 DEBUG [member: 'jenkins-hbase4.apache.org,44453,1676246620575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 00:03:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35171,1676246620621': 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35171,1676246620621' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:45,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44453,1676246620575': 2023-02-13 00:03:45,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44453,1676246620575' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 00:03:45,346 INFO [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 00:03:45,346 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:45,346 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:45,346 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 00:03:45,346 INFO [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:03:45,347 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,347 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,347 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,348 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:45,347 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:45,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:45,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:45,348 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:45,349 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,351 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:45,351 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:03:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:45,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:45,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:45,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:45,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 00:03:45,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:03:45,355 DEBUG [(jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:03:45,355 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,356 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,356 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,356 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:03:45,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:45,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:45,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:45,356 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:45,356 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:03:45,357 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:03:45,457 DEBUG [Listener at localhost/38137] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:03:45,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44265] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:03:45,459 INFO [Listener at localhost/38137] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:03:45,459 DEBUG [Listener at localhost/38137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f12cae5 to 127.0.0.1:60508 2023-02-13 00:03:45,459 DEBUG [Listener at localhost/38137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:45,460 DEBUG [Listener at localhost/38137] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:03:45,460 DEBUG [Listener at localhost/38137] util.JVMClusterUtil(257): Found active master hash=448619431, stopped=false 2023-02-13 00:03:45,460 INFO [Listener at localhost/38137] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:45,462 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:45,462 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:45,462 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:45,462 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:45,462 INFO [Listener at localhost/38137] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:03:45,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:45,462 DEBUG [Listener at localhost/38137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24ba5051 to 127.0.0.1:60508 2023-02-13 00:03:45,462 DEBUG [Listener at localhost/38137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:45,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:45,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:45,464 INFO [Listener at localhost/38137] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44453,1676246620575' ***** 2023-02-13 00:03:45,464 INFO [Listener at localhost/38137] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:45,464 INFO [Listener at localhost/38137] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35171,1676246620621' ***** 2023-02-13 00:03:45,464 INFO [Listener at localhost/38137] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:45,464 INFO [RS:0;jenkins-hbase4:44453] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:45,464 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:45,464 INFO [RS:1;jenkins-hbase4:35171] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:45,465 INFO [RS:0;jenkins-hbase4:44453] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:45,465 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:45,465 INFO [RS:1;jenkins-hbase4:35171] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:45,465 INFO [RS:0;jenkins-hbase4:44453] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:45,466 INFO [RS:1;jenkins-hbase4:35171] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:45,466 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(3304): Received CLOSE for 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:45,466 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(3304): Received CLOSE for 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:45,466 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(3304): Received CLOSE for 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:45,467 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(3304): Received CLOSE for 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 762f4c654acaee6df0e96477fa7381c4, disabling compactions & flushes 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 43a9c7b974b83e70fc6dd7e193f184f0, disabling compactions & flushes 2023-02-13 00:03:45,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:45,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:45,467 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(3304): Received CLOSE for 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(3304): Received CLOSE for baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:45,467 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(3304): Received CLOSE for 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(3304): Received CLOSE for 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(3304): Received CLOSE for 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. after waiting 0 ms 2023-02-13 00:03:45,467 DEBUG [RS:0;jenkins-hbase4:44453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ace32d5 to 127.0.0.1:60508 2023-02-13 00:03:45,467 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(3304): Received CLOSE for 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:45,467 DEBUG [RS:0;jenkins-hbase4:44453] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:45,467 INFO [RS:0;jenkins-hbase4:44453] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:45,468 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:03:45,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. after waiting 0 ms 2023-02-13 00:03:45,467 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(3304): Received CLOSE for 4cd3b881a1bf99f85f12fac230071c9f 2023-02-13 00:03:45,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:45,468 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,468 DEBUG [RS:1;jenkins-hbase4:35171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13652343 to 127.0.0.1:60508 2023-02-13 00:03:45,468 DEBUG [RS:1;jenkins-hbase4:35171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:45,468 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 00:03:45,468 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1479): Online Regions={43a9c7b974b83e70fc6dd7e193f184f0=testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0., 619db296ff6d7014fd9ca553592788bf=testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf., 457b1682113ec60e93922fdb95420ad5=testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5., 81253aedf8d8cf083c1faf41738af691=testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691., 41383a8178f40da3b1b60f5e130b38b4=testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4., 4cd3b881a1bf99f85f12fac230071c9f=hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f.} 2023-02-13 00:03:45,468 DEBUG [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1505): Waiting on 41383a8178f40da3b1b60f5e130b38b4, 43a9c7b974b83e70fc6dd7e193f184f0, 457b1682113ec60e93922fdb95420ad5, 4cd3b881a1bf99f85f12fac230071c9f, 619db296ff6d7014fd9ca553592788bf, 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:45,468 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 00:03:45,468 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1479): Online Regions={762f4c654acaee6df0e96477fa7381c4=testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4., 8135349477b19c3998d47bdb822690b5=testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5., 1588230740=hbase:meta,,1.1588230740, baa6c7b62b7e293fa106c12fdd85618f=testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f., 9f9ea029dc149ace45c4f4c605a14834=testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834., 85114851d4628826eb63d2a93ef50707=testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.} 2023-02-13 00:03:45,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:45,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:45,468 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1505): Waiting on 1588230740, 762f4c654acaee6df0e96477fa7381c4, 8135349477b19c3998d47bdb822690b5, 85114851d4628826eb63d2a93ef50707, 9f9ea029dc149ace45c4f4c605a14834, baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:45,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:45,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:45,470 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:45,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-13 00:03:45,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:45,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 43a9c7b974b83e70fc6dd7e193f184f0: Waiting for close lock at 1676246625467Running coprocessor pre-close hooks at 1676246625467Disabling compacts and flushes for region at 1676246625467Disabling writes for close at 1676246625467Writing region close event to WAL at 1676246625477 (+10 ms)Running coprocessor post-close hooks at 1676246625485 (+8 ms)Closed at 1676246625486 (+1 ms) 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 762f4c654acaee6df0e96477fa7381c4: Waiting for close lock at 1676246625467Running coprocessor pre-close hooks at 1676246625467Disabling compacts and flushes for region at 1676246625467Disabling writes for close at 1676246625468 (+1 ms)Writing region close event to WAL at 1676246625481 (+13 ms)Running coprocessor post-close hooks at 1676246625485 (+4 ms)Closed at 1676246625486 (+1 ms) 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 619db296ff6d7014fd9ca553592788bf, disabling compactions & flushes 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8135349477b19c3998d47bdb822690b5, disabling compactions & flushes 2023-02-13 00:03:45,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:45,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. after waiting 0 ms 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. after waiting 0 ms 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:45,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:45,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,503 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/.tmp/info/c69ac1ef13394f8abca3e6bde13bee79 2023-02-13 00:03:45,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:45,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 619db296ff6d7014fd9ca553592788bf: Waiting for close lock at 1676246625486Running coprocessor pre-close hooks at 1676246625486Disabling compacts and flushes for region at 1676246625486Disabling writes for close at 1676246625486Writing region close event to WAL at 1676246625499 (+13 ms)Running coprocessor post-close hooks at 1676246625504 (+5 ms)Closed at 1676246625504 2023-02-13 00:03:45,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:45,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 457b1682113ec60e93922fdb95420ad5, disabling compactions & flushes 2023-02-13 00:03:45,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:45,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:45,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. after waiting 0 ms 2023-02-13 00:03:45,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:45,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:45,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8135349477b19c3998d47bdb822690b5: Waiting for close lock at 1676246625486Running coprocessor pre-close hooks at 1676246625486Disabling compacts and flushes for region at 1676246625486Disabling writes for close at 1676246625486Writing region close event to WAL at 1676246625499 (+13 ms)Running coprocessor post-close hooks at 1676246625505 (+6 ms)Closed at 1676246625506 (+1 ms) 2023-02-13 00:03:45,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:45,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing baa6c7b62b7e293fa106c12fdd85618f, disabling compactions & flushes 2023-02-13 00:03:45,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:45,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:45,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. after waiting 0 ms 2023-02-13 00:03:45,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:45,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:45,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 457b1682113ec60e93922fdb95420ad5: Waiting for close lock at 1676246625505Running coprocessor pre-close hooks at 1676246625505Disabling compacts and flushes for region at 1676246625505Disabling writes for close at 1676246625505Writing region close event to WAL at 1676246625508 (+3 ms)Running coprocessor post-close hooks at 1676246625512 (+4 ms)Closed at 1676246625516 (+4 ms) 2023-02-13 00:03:45,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:45,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 81253aedf8d8cf083c1faf41738af691, disabling compactions & flushes 2023-02-13 00:03:45,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:45,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:45,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. after waiting 0 ms 2023-02-13 00:03:45,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:45,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:45,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for baa6c7b62b7e293fa106c12fdd85618f: Waiting for close lock at 1676246625506Running coprocessor pre-close hooks at 1676246625506Disabling compacts and flushes for region at 1676246625506Disabling writes for close at 1676246625506Writing region close event to WAL at 1676246625509 (+3 ms)Running coprocessor post-close hooks at 1676246625518 (+9 ms)Closed at 1676246625518 2023-02-13 00:03:45,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:45,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9f9ea029dc149ace45c4f4c605a14834, disabling compactions & flushes 2023-02-13 00:03:45,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:45,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:45,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. after waiting 0 ms 2023-02-13 00:03:45,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:45,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:45,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:45,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9f9ea029dc149ace45c4f4c605a14834: Waiting for close lock at 1676246625518Running coprocessor pre-close hooks at 1676246625518Disabling compacts and flushes for region at 1676246625518Disabling writes for close at 1676246625518Writing region close event to WAL at 1676246625523 (+5 ms)Running coprocessor post-close hooks at 1676246625529 (+6 ms)Closed at 1676246625530 (+1 ms) 2023-02-13 00:03:45,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 81253aedf8d8cf083c1faf41738af691: Waiting for close lock at 1676246625517Running coprocessor pre-close hooks at 1676246625517Disabling compacts and flushes for region at 1676246625517Disabling writes for close at 1676246625517Writing region close event to WAL at 1676246625523 (+6 ms)Running coprocessor post-close hooks at 1676246625530 (+7 ms)Closed at 1676246625532 (+2 ms) 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 85114851d4628826eb63d2a93ef50707, disabling compactions & flushes 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:45,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41383a8178f40da3b1b60f5e130b38b4, disabling compactions & flushes 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. after waiting 0 ms 2023-02-13 00:03:45,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:45,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. after waiting 0 ms 2023-02-13 00:03:45,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:45,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 00:03:45,539 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:45,539 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:45,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:45,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41383a8178f40da3b1b60f5e130b38b4: Waiting for close lock at 1676246625532Running coprocessor pre-close hooks at 1676246625532Disabling compacts and flushes for region at 1676246625532Disabling writes for close at 1676246625533 (+1 ms)Writing region close event to WAL at 1676246625536 (+3 ms)Running coprocessor post-close hooks at 1676246625541 (+5 ms)Closed at 1676246625541 2023-02-13 00:03:45,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:45,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4cd3b881a1bf99f85f12fac230071c9f, disabling compactions & flushes 2023-02-13 00:03:45,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:45,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:45,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. after waiting 0 ms 2023-02-13 00:03:45,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:45,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4cd3b881a1bf99f85f12fac230071c9f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:03:45,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 00:03:45,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:45,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 85114851d4628826eb63d2a93ef50707: Waiting for close lock at 1676246625532Running coprocessor pre-close hooks at 1676246625532Disabling compacts and flushes for region at 1676246625532Disabling writes for close at 1676246625532Writing region close event to WAL at 1676246625536 (+4 ms)Running coprocessor post-close hooks at 1676246625542 (+6 ms)Closed at 1676246625542 2023-02-13 00:03:45,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:45,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/.tmp/info/c893111b32ee4267a26e76b7d507e8b8 2023-02-13 00:03:45,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/.tmp/info/c893111b32ee4267a26e76b7d507e8b8 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/info/c893111b32ee4267a26e76b7d507e8b8 2023-02-13 00:03:45,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/info/c893111b32ee4267a26e76b7d507e8b8, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:03:45,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4cd3b881a1bf99f85f12fac230071c9f in 24ms, sequenceid=6, compaction requested=false 2023-02-13 00:03:45,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 00:03:45,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/namespace/4cd3b881a1bf99f85f12fac230071c9f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:03:45,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:45,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4cd3b881a1bf99f85f12fac230071c9f: Waiting for close lock at 1676246625541Running coprocessor pre-close hooks at 1676246625541Disabling compacts and flushes for region at 1676246625541Disabling writes for close at 1676246625541Obtaining lock to block concurrent updates at 1676246625541Preparing flush snapshotting stores in 4cd3b881a1bf99f85f12fac230071c9f at 1676246625541Finished memstore snapshotting hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246625541Flushing stores of hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. at 1676246625545 (+4 ms)Flushing 4cd3b881a1bf99f85f12fac230071c9f/info: creating writer at 1676246625545Flushing 4cd3b881a1bf99f85f12fac230071c9f/info: appending metadata at 1676246625547 (+2 ms)Flushing 4cd3b881a1bf99f85f12fac230071c9f/info: closing flushed file at 1676246625547Flushing 4cd3b881a1bf99f85f12fac230071c9f/info: reopening flushed file at 1676246625558 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4cd3b881a1bf99f85f12fac230071c9f in 24ms, sequenceid=6, compaction requested=false at 1676246625565 (+7 ms)Writing region close event to WAL at 1676246625566 (+1 ms)Running coprocessor post-close hooks at 1676246625569 (+3 ms)Closed at 1676246625569 2023-02-13 00:03:45,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246621412.4cd3b881a1bf99f85f12fac230071c9f. 2023-02-13 00:03:45,668 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35171,1676246620621; all regions closed. 2023-02-13 00:03:45,669 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:03:45,673 DEBUG [RS:1;jenkins-hbase4:35171] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/oldWALs 2023-02-13 00:03:45,673 INFO [RS:1;jenkins-hbase4:35171] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35171%2C1676246620621:(num 1676246621838) 2023-02-13 00:03:45,673 DEBUG [RS:1;jenkins-hbase4:35171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:45,673 INFO [RS:1;jenkins-hbase4:35171] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:45,674 INFO [RS:1;jenkins-hbase4:35171] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:45,674 INFO [RS:1;jenkins-hbase4:35171] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:45,674 INFO [RS:1;jenkins-hbase4:35171] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:45,674 INFO [RS:1;jenkins-hbase4:35171] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:45,674 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:45,675 INFO [RS:1;jenkins-hbase4:35171] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35171 2023-02-13 00:03:45,677 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,677 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35171,1676246620621 2023-02-13 00:03:45,677 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:45,677 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:45,677 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18d22055 rejected from java.util.concurrent.ThreadPoolExecutor@1cedb797[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:45,677 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:45,678 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35171,1676246620621] 2023-02-13 00:03:45,678 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35171,1676246620621; numProcessing=1 2023-02-13 00:03:45,683 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35171,1676246620621 already deleted, retry=false 2023-02-13 00:03:45,683 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35171,1676246620621 expired; onlineServers=1 2023-02-13 00:03:45,869 DEBUG [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:03:45,934 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/.tmp/table/0b768ee977fd4befb6b90b3f24b9ed09 2023-02-13 00:03:45,937 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 00:03:45,937 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 00:03:45,940 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/.tmp/info/c69ac1ef13394f8abca3e6bde13bee79 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/info/c69ac1ef13394f8abca3e6bde13bee79 2023-02-13 00:03:45,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/info/c69ac1ef13394f8abca3e6bde13bee79, entries=110, sequenceid=32, filesize=18.7 K 2023-02-13 00:03:45,946 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/.tmp/table/0b768ee977fd4befb6b90b3f24b9ed09 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/table/0b768ee977fd4befb6b90b3f24b9ed09 2023-02-13 00:03:45,951 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/table/0b768ee977fd4befb6b90b3f24b9ed09, entries=4, sequenceid=32, filesize=4.8 K 2023-02-13 00:03:45,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 482ms, sequenceid=32, compaction requested=false 2023-02-13 00:03:45,952 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 00:03:45,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-13 00:03:45,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:03:45,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:45,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246625468Running coprocessor pre-close hooks at 1676246625468Disabling compacts and flushes for region at 1676246625468Disabling writes for close at 1676246625470 (+2 ms)Obtaining lock to block concurrent updates at 1676246625472 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1676246625472Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676246625472Flushing stores of hbase:meta,,1.1588230740 at 1676246625477 (+5 ms)Flushing 1588230740/info: creating writer at 1676246625477Flushing 1588230740/info: appending metadata at 1676246625483 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676246625483Flushing 1588230740/table: creating writer at 1676246625511 (+28 ms)Flushing 1588230740/table: appending metadata at 1676246625517 (+6 ms)Flushing 1588230740/table: closing flushed file at 1676246625517Flushing 1588230740/info: reopening flushed file at 1676246625941 (+424 ms)Flushing 1588230740/table: reopening flushed file at 1676246625947 (+6 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 482ms, sequenceid=32, compaction requested=false at 1676246625952 (+5 ms)Writing region close event to WAL at 1676246625953 (+1 ms)Running coprocessor post-close hooks at 1676246625956 (+3 ms)Closed at 1676246625957 (+1 ms) 2023-02-13 00:03:45,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:45,963 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:45,963 INFO [RS:1;jenkins-hbase4:35171] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35171,1676246620621; zookeeper connection closed. 2023-02-13 00:03:45,963 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@61a52750 rejected from java.util.concurrent.ThreadPoolExecutor@1cedb797[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:45,963 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b3957fd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b3957fd 2023-02-13 00:03:45,963 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:35171-0x1004afd82f60002, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:45,963 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19dc202e rejected from java.util.concurrent.ThreadPoolExecutor@1cedb797[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:46,069 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44453,1676246620575; all regions closed. 2023-02-13 00:03:46,074 DEBUG [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/oldWALs 2023-02-13 00:03:46,075 INFO [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44453%2C1676246620575.meta:.meta(num 1676246621268) 2023-02-13 00:03:46,079 DEBUG [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/oldWALs 2023-02-13 00:03:46,079 INFO [RS:0;jenkins-hbase4:44453] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44453%2C1676246620575:(num 1676246621982) 2023-02-13 00:03:46,079 DEBUG [RS:0;jenkins-hbase4:44453] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:46,079 INFO [RS:0;jenkins-hbase4:44453] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:46,079 INFO [RS:0;jenkins-hbase4:44453] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:46,079 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:46,080 INFO [RS:0;jenkins-hbase4:44453] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44453 2023-02-13 00:03:46,082 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44453,1676246620575 2023-02-13 00:03:46,082 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:46,082 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e66544b rejected from java.util.concurrent.ThreadPoolExecutor@a59c15f[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:46,083 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44453,1676246620575] 2023-02-13 00:03:46,083 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44453,1676246620575; numProcessing=2 2023-02-13 00:03:46,084 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44453,1676246620575 already deleted, retry=false 2023-02-13 00:03:46,084 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44453,1676246620575 expired; onlineServers=0 2023-02-13 00:03:46,085 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44265,1676246620495' ***** 2023-02-13 00:03:46,085 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:03:46,086 DEBUG [M:0;jenkins-hbase4:44265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b80699c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:46,086 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44265,1676246620495 2023-02-13 00:03:46,086 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44265,1676246620495; all regions closed. 2023-02-13 00:03:46,086 DEBUG [M:0;jenkins-hbase4:44265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:46,086 DEBUG [M:0;jenkins-hbase4:44265] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:03:46,086 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:03:46,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246620828] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246620828,5,FailOnTimeoutGroup] 2023-02-13 00:03:46,086 DEBUG [M:0;jenkins-hbase4:44265] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:03:46,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246620828] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246620828,5,FailOnTimeoutGroup] 2023-02-13 00:03:46,087 INFO [M:0;jenkins-hbase4:44265] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:03:46,087 INFO [M:0;jenkins-hbase4:44265] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:03:46,088 INFO [M:0;jenkins-hbase4:44265] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:03:46,088 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:46,088 DEBUG [M:0;jenkins-hbase4:44265] master.HMaster(1502): Stopping service threads 2023-02-13 00:03:46,088 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:46,088 INFO [M:0;jenkins-hbase4:44265] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:03:46,088 ERROR [M:0;jenkins-hbase4:44265] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 00:03:46,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:46,088 INFO [M:0;jenkins-hbase4:44265] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:03:46,089 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:03:46,089 DEBUG [M:0;jenkins-hbase4:44265] zookeeper.ZKUtil(398): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 00:03:46,089 WARN [M:0;jenkins-hbase4:44265] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 00:03:46,089 INFO [M:0;jenkins-hbase4:44265] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:03:46,090 INFO [M:0;jenkins-hbase4:44265] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:03:46,090 DEBUG [M:0;jenkins-hbase4:44265] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:46,090 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:46,090 DEBUG [M:0;jenkins-hbase4:44265] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:46,090 DEBUG [M:0;jenkins-hbase4:44265] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:46,090 DEBUG [M:0;jenkins-hbase4:44265] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:46,090 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-13 00:03:46,099 INFO [M:0;jenkins-hbase4:44265] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ba56afe2abc24517b903a19b93c0e474 2023-02-13 00:03:46,104 DEBUG [M:0;jenkins-hbase4:44265] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ba56afe2abc24517b903a19b93c0e474 as hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ba56afe2abc24517b903a19b93c0e474 2023-02-13 00:03:46,109 INFO [M:0;jenkins-hbase4:44265] regionserver.HStore(1080): Added hdfs://localhost:32903/user/jenkins/test-data/b41e39e4-d0a6-6196-f0ad-43a41972e791/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ba56afe2abc24517b903a19b93c0e474, entries=31, sequenceid=218, filesize=9.0 K 2023-02-13 00:03:46,111 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-13 00:03:46,111 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:46,111 DEBUG [M:0;jenkins-hbase4:44265] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246626090Disabling compacts and flushes for region at 1676246626090Disabling writes for close at 1676246626090Obtaining lock to block concurrent updates at 1676246626090Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246626090Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676246626090Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246626091 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246626091Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246626094 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246626094Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246626105 (+11 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false at 1676246626111 (+6 ms)Writing region close event to WAL at 1676246626111Closed at 1676246626111 2023-02-13 00:03:46,115 INFO [M:0;jenkins-hbase4:44265] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:03:46,115 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:46,116 INFO [M:0;jenkins-hbase4:44265] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44265 2023-02-13 00:03:46,119 DEBUG [M:0;jenkins-hbase4:44265] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44265,1676246620495 already deleted, retry=false 2023-02-13 00:03:46,184 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:46,184 INFO [RS:0;jenkins-hbase4:44453] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44453,1676246620575; zookeeper connection closed. 2023-02-13 00:03:46,184 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42a66566 rejected from java.util.concurrent.ThreadPoolExecutor@a59c15f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:46,184 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): regionserver:44453-0x1004afd82f60001, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:46,184 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3697ac22] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3697ac22 2023-02-13 00:03:46,184 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ac9d0c8 rejected from java.util.concurrent.ThreadPoolExecutor@a59c15f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:46,184 INFO [Listener at localhost/38137] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:03:46,284 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:46,284 INFO [M:0;jenkins-hbase4:44265] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44265,1676246620495; zookeeper connection closed. 2023-02-13 00:03:46,284 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70ce715 rejected from java.util.concurrent.ThreadPoolExecutor@333732c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:46,285 DEBUG [Listener at localhost/38137-EventThread] zookeeper.ZKWatcher(600): master:44265-0x1004afd82f60000, quorum=127.0.0.1:60508, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:46,285 ERROR [Listener at localhost/38137-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1769044c rejected from java.util.concurrent.ThreadPoolExecutor@333732c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:46,373 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop-1089766373229106871.jar 2023-02-13 00:03:46,377 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676246622914 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:46,377 DEBUG [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(239): region to add: 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:46,378 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=762f4c654acaee6df0e96477fa7381c4 as 762f4c654acaee6df0e96477fa7381c4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=8135349477b19c3998d47bdb822690b5 as 8135349477b19c3998d47bdb822690b5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=43a9c7b974b83e70fc6dd7e193f184f0 as 43a9c7b974b83e70fc6dd7e193f184f0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=619db296ff6d7014fd9ca553592788bf as 619db296ff6d7014fd9ca553592788bf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=457b1682113ec60e93922fdb95420ad5 as 457b1682113ec60e93922fdb95420ad5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=baa6c7b62b7e293fa106c12fdd85618f as baa6c7b62b7e293fa106c12fdd85618f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=81253aedf8d8cf083c1faf41738af691 as 81253aedf8d8cf083c1faf41738af691 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=9f9ea029dc149ace45c4f4c605a14834 as 9f9ea029dc149ace45c4f4c605a14834 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=85114851d4628826eb63d2a93ef50707 as 85114851d4628826eb63d2a93ef50707 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,379 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(585): clone region=41383a8178f40da3b1b60f5e130b38b4 as 41383a8178f40da3b1b60f5e130b38b4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 00:03:46,380 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 43a9c7b974b83e70fc6dd7e193f184f0, NAME => 'testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,381 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 457b1682113ec60e93922fdb95420ad5, NAME => 'testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,381 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 762f4c654acaee6df0e96477fa7381c4, NAME => 'testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,381 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 619db296ff6d7014fd9ca553592788bf, NAME => 'testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,381 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 81253aedf8d8cf083c1faf41738af691, NAME => 'testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,382 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8135349477b19c3998d47bdb822690b5, NAME => 'testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,382 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => baa6c7b62b7e293fa106c12fdd85618f, NAME => 'testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,384 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 9f9ea029dc149ace45c4f4c605a14834, NAME => 'testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,421 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,421 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 87f9560224644cbd905ad282d80ec21d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,424 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,424 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91dce44790824653a7cb57ddca6c29da from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,424 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,424 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,425 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a3cbc16b2a44d0ba98e4ccc64686964 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,424 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f74c1b310e14db6a4d9103cc0556f46 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,426 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,427 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,427 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac95ef5616d44f5fb510d9b6e9f40493 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,427 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9a8f7724dcb41c1ae838078a239e6e8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,427 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e977aee72ba54d579aae69edbf4ea89d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,439 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,439 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 24be38a1264547b9a25dc0a6e887070e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,439 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f189bb34596b4cfaa7fe54267c5ff537 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,439 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee05464773d74ac4a5ff0fee4c07b8cf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,439 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 81253aedf8d8cf083c1faf41738af691, disabling compactions & flushes 2023-02-13 00:03:46,440 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:46,440 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e3aa879b84a548de9c52f45a2d80585b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,440 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9b90870e1274910aafbca487a730bb2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,440 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:46,440 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. after waiting 0 ms 2023-02-13 00:03:46,440 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:46,440 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:46,440 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e17cb8023aa24abaa0c979528bd25d50 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,440 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 81253aedf8d8cf083c1faf41738af691: Waiting for close lock at 1676246626439Disabling compacts and flushes for region at 1676246626439Disabling writes for close at 1676246626440 (+1 ms)Writing region close event to WAL at 1676246626440Closed at 1676246626440 2023-02-13 00:03:46,441 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 85114851d4628826eb63d2a93ef50707, NAME => 'testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 457b1682113ec60e93922fdb95420ad5, disabling compactions & flushes 2023-02-13 00:03:46,444 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 43a9c7b974b83e70fc6dd7e193f184f0, disabling compactions & flushes 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. after waiting 0 ms 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:46,444 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. after waiting 0 ms 2023-02-13 00:03:46,444 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:46,445 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:46,445 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 43a9c7b974b83e70fc6dd7e193f184f0: Waiting for close lock at 1676246626444Disabling compacts and flushes for region at 1676246626444Disabling writes for close at 1676246626444Writing region close event to WAL at 1676246626445 (+1 ms)Closed at 1676246626445 2023-02-13 00:03:46,445 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing baa6c7b62b7e293fa106c12fdd85618f, disabling compactions & flushes 2023-02-13 00:03:46,444 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:46,446 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 41383a8178f40da3b1b60f5e130b38b4, NAME => 'testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,446 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 457b1682113ec60e93922fdb95420ad5: Waiting for close lock at 1676246626444Disabling compacts and flushes for region at 1676246626444Disabling writes for close at 1676246626444Writing region close event to WAL at 1676246626444Closed at 1676246626444 2023-02-13 00:03:46,446 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:46,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:46,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. after waiting 0 ms 2023-02-13 00:03:46,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:46,446 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:46,446 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for baa6c7b62b7e293fa106c12fdd85618f: Waiting for close lock at 1676246626445Disabling compacts and flushes for region at 1676246626445Disabling writes for close at 1676246626446 (+1 ms)Writing region close event to WAL at 1676246626446Closed at 1676246626446 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 619db296ff6d7014fd9ca553592788bf, disabling compactions & flushes 2023-02-13 00:03:46,447 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. after waiting 0 ms 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:46,447 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 8135349477b19c3998d47bdb822690b5, disabling compactions & flushes 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 619db296ff6d7014fd9ca553592788bf: Waiting for close lock at 1676246626447Disabling compacts and flushes for region at 1676246626447Disabling writes for close at 1676246626447Writing region close event to WAL at 1676246626447Closed at 1676246626447 2023-02-13 00:03:46,447 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:46,447 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e8f88d232f81453184d642f135db3645 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. after waiting 0 ms 2023-02-13 00:03:46,447 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:46,448 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:46,448 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 8135349477b19c3998d47bdb822690b5: Waiting for close lock at 1676246626447Disabling compacts and flushes for region at 1676246626447Disabling writes for close at 1676246626447Writing region close event to WAL at 1676246626447Closed at 1676246626448 (+1 ms) 2023-02-13 00:03:46,455 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 9f9ea029dc149ace45c4f4c605a14834, disabling compactions & flushes 2023-02-13 00:03:46,456 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:46,456 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:46,456 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. after waiting 0 ms 2023-02-13 00:03:46,456 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:46,456 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:46,456 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 9f9ea029dc149ace45c4f4c605a14834: Waiting for close lock at 1676246626455Disabling compacts and flushes for region at 1676246626455Disabling writes for close at 1676246626456 (+1 ms)Writing region close event to WAL at 1676246626456Closed at 1676246626456 2023-02-13 00:03:46,458 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,458 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 85114851d4628826eb63d2a93ef50707, disabling compactions & flushes 2023-02-13 00:03:46,458 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:46,458 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:46,458 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. after waiting 0 ms 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:46,459 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 85114851d4628826eb63d2a93ef50707: Waiting for close lock at 1676246626458Disabling compacts and flushes for region at 1676246626458Disabling writes for close at 1676246626459 (+1 ms)Writing region close event to WAL at 1676246626459Closed at 1676246626459 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 41383a8178f40da3b1b60f5e130b38b4, disabling compactions & flushes 2023-02-13 00:03:46,459 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. after waiting 0 ms 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:46,459 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:46,459 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 41383a8178f40da3b1b60f5e130b38b4: Waiting for close lock at 1676246626459Disabling compacts and flushes for region at 1676246626459Disabling writes for close at 1676246626459Writing region close event to WAL at 1676246626459Closed at 1676246626459 2023-02-13 00:03:46,825 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:46,825 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8f2e687df7054f8bbd7aea8606360712 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,828 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1ae2a90ca3934ffc935b197a91a5f165 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 00:03:46,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 762f4c654acaee6df0e96477fa7381c4, disabling compactions & flushes 2023-02-13 00:03:46,830 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:46,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:46,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. after waiting 0 ms 2023-02-13 00:03:46,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:46,831 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:46,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 762f4c654acaee6df0e96477fa7381c4: Waiting for close lock at 1676246626830Disabling compacts and flushes for region at 1676246626830Disabling writes for close at 1676246626830Writing region close event to WAL at 1676246626831 (+1 ms)Closed at 1676246626831 2023-02-13 00:03:46,831 INFO [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676246622914 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:46,831 DEBUG [Listener at localhost/38137] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,831 DEBUG [Listener at localhost/38137] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea 2023-02-13 00:03:46,832 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-data/ 2023-02-13 00:03:46,832 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----default/ 2023-02-13 00:03:46,833 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 00:03:46,834 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------41383a8178f40da3b1b60f5e130b38b4/ 2023-02-13 00:03:46,834 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,834 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------43a9c7b974b83e70fc6dd7e193f184f0/ 2023-02-13 00:03:46,835 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,835 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,835 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=43a9c7b974b83e70fc6dd7e193f184f0-91dce44790824653a7cb57ddca6c29da 2023-02-13 00:03:46,835 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,836 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=43a9c7b974b83e70fc6dd7e193f184f0-24be38a1264547b9a25dc0a6e887070e 2023-02-13 00:03:46,836 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------457b1682113ec60e93922fdb95420ad5/ 2023-02-13 00:03:46,836 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,837 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,837 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=457b1682113ec60e93922fdb95420ad5-e977aee72ba54d579aae69edbf4ea89d 2023-02-13 00:03:46,837 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,838 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=457b1682113ec60e93922fdb95420ad5-e3aa879b84a548de9c52f45a2d80585b 2023-02-13 00:03:46,838 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------619db296ff6d7014fd9ca553592788bf/ 2023-02-13 00:03:46,838 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,838 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,839 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=619db296ff6d7014fd9ca553592788bf-ac95ef5616d44f5fb510d9b6e9f40493 2023-02-13 00:03:46,839 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,839 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=619db296ff6d7014fd9ca553592788bf-e9b90870e1274910aafbca487a730bb2 2023-02-13 00:03:46,839 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------762f4c654acaee6df0e96477fa7381c4/ 2023-02-13 00:03:46,840 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,840 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,840 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=762f4c654acaee6df0e96477fa7381c4-8f2e687df7054f8bbd7aea8606360712 2023-02-13 00:03:46,840 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,841 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=762f4c654acaee6df0e96477fa7381c4-1ae2a90ca3934ffc935b197a91a5f165 2023-02-13 00:03:46,841 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------81253aedf8d8cf083c1faf41738af691/ 2023-02-13 00:03:46,841 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,841 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,842 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=81253aedf8d8cf083c1faf41738af691-87f9560224644cbd905ad282d80ec21d 2023-02-13 00:03:46,842 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,843 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=81253aedf8d8cf083c1faf41738af691-a9a8f7724dcb41c1ae838078a239e6e8 2023-02-13 00:03:46,843 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------8135349477b19c3998d47bdb822690b5/ 2023-02-13 00:03:46,843 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,844 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,844 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=8135349477b19c3998d47bdb822690b5-0f74c1b310e14db6a4d9103cc0556f46 2023-02-13 00:03:46,844 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,845 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=8135349477b19c3998d47bdb822690b5-e17cb8023aa24abaa0c979528bd25d50 2023-02-13 00:03:46,845 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------85114851d4628826eb63d2a93ef50707/ 2023-02-13 00:03:46,845 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,845 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------9f9ea029dc149ace45c4f4c605a14834/ 2023-02-13 00:03:46,846 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,846 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,846 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=9f9ea029dc149ace45c4f4c605a14834-f189bb34596b4cfaa7fe54267c5ff537 2023-02-13 00:03:46,847 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,847 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=9f9ea029dc149ace45c4f4c605a14834-e8f88d232f81453184d642f135db3645 2023-02-13 00:03:46,847 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |----------baa6c7b62b7e293fa106c12fdd85618f/ 2023-02-13 00:03:46,848 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:46,848 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:46,848 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=baa6c7b62b7e293fa106c12fdd85618f-8a3cbc16b2a44d0ba98e4ccc64686964 2023-02-13 00:03:46,848 DEBUG [Listener at localhost/38137] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:46,849 DEBUG [Listener at localhost/38137] util.CommonFSUtils(702): |----------------testWithMapReduce=baa6c7b62b7e293fa106c12fdd85618f-ee05464773d74ac4a5ff0fee4c07b8cf 2023-02-13 00:03:46,849 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,849 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,850 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,850 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,850 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,851 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,851 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,917 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop-7579773717239161802.jar 2023-02-13 00:03:46,917 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,918 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,918 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,918 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,919 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,919 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,919 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 00:03:46,920 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 00:03:46,920 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 00:03:46,921 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 00:03:46,921 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 00:03:46,921 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 00:03:46,922 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 00:03:46,922 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 00:03:46,922 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 00:03:46,923 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 00:03:46,923 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 00:03:46,923 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:03:46,924 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:03:46,924 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:03:46,924 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 00:03:46,990 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop-284650682750778780.jar 2023-02-13 00:03:46,991 DEBUG [Listener at localhost/38137] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 00:03:46,996 WARN [Listener at localhost/38137] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 00:03:47,026 INFO [Listener at localhost/38137] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 00:03:47,147 WARN [Listener at localhost/38137] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/mapreduce.cluster.local.dir/1676246627110/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 00:03:47,147 WARN [Listener at localhost/38137] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/mapreduce.cluster.local.dir/1676246627110/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 00:03:47,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,194 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,195 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,197 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:47,198 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1 2023-02-13 00:03:47,199 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 457b1682113ec60e93922fdb95420ad5 columnFamilyName f1 2023-02-13 00:03:47,205 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f1/testWithMapReduce=457b1682113ec60e93922fdb95420ad5-e977aee72ba54d579aae69edbf4ea89d 2023-02-13 00:03:47,205 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(310): Store=457b1682113ec60e93922fdb95420ad5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,205 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 457b1682113ec60e93922fdb95420ad5 2023-02-13 00:03:47,206 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2 2023-02-13 00:03:47,207 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 457b1682113ec60e93922fdb95420ad5 columnFamilyName f2 2023-02-13 00:03:47,211 DEBUG [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/457b1682113ec60e93922fdb95420ad5/f2/testWithMapReduce=457b1682113ec60e93922fdb95420ad5-e3aa879b84a548de9c52f45a2d80585b 2023-02-13 00:03:47,212 INFO [StoreOpener-457b1682113ec60e93922fdb95420ad5-1] regionserver.HStore(310): Store=457b1682113ec60e93922fdb95420ad5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,212 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 457b1682113ec60e93922fdb95420ad5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64612776, jitterRate=-0.03719460964202881}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 457b1682113ec60e93922fdb95420ad5: Writing region info on filesystem at 1676246627195Initializing all the Stores at 1676246627197 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627197Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627197Region opened successfully at 1676246627212 (+15 ms) 2023-02-13 00:03:47,251 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 457b1682113ec60e93922fdb95420ad5, disabling compactions & flushes 2023-02-13 00:03:47,252 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:47,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:47,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. after waiting 0 ms 2023-02-13 00:03:47,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:47,253 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676246622072.457b1682113ec60e93922fdb95420ad5. 2023-02-13 00:03:47,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 457b1682113ec60e93922fdb95420ad5: Waiting for close lock at 1676246627251Disabling compacts and flushes for region at 1676246627251Disabling writes for close at 1676246627252 (+1 ms)Writing region close event to WAL at 1676246627253 (+1 ms)Closed at 1676246627253 2023-02-13 00:03:47,257 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,257 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,258 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,259 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:47,261 DEBUG [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/f1 2023-02-13 00:03:47,261 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41383a8178f40da3b1b60f5e130b38b4 columnFamilyName f1 2023-02-13 00:03:47,262 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(310): Store=41383a8178f40da3b1b60f5e130b38b4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,262 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41383a8178f40da3b1b60f5e130b38b4 2023-02-13 00:03:47,263 DEBUG [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/41383a8178f40da3b1b60f5e130b38b4/f2 2023-02-13 00:03:47,263 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41383a8178f40da3b1b60f5e130b38b4 columnFamilyName f2 2023-02-13 00:03:47,264 INFO [StoreOpener-41383a8178f40da3b1b60f5e130b38b4-1] regionserver.HStore(310): Store=41383a8178f40da3b1b60f5e130b38b4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,264 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 41383a8178f40da3b1b60f5e130b38b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59928924, jitterRate=-0.10698944330215454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 41383a8178f40da3b1b60f5e130b38b4: Writing region info on filesystem at 1676246627258Initializing all the Stores at 1676246627259 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627259Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627259Region opened successfully at 1676246627264 (+5 ms) 2023-02-13 00:03:47,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 41383a8178f40da3b1b60f5e130b38b4, disabling compactions & flushes 2023-02-13 00:03:47,281 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:47,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:47,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. after waiting 0 ms 2023-02-13 00:03:47,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:47,282 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246622072.41383a8178f40da3b1b60f5e130b38b4. 2023-02-13 00:03:47,282 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 41383a8178f40da3b1b60f5e130b38b4: Waiting for close lock at 1676246627281Disabling compacts and flushes for region at 1676246627281Disabling writes for close at 1676246627281Writing region close event to WAL at 1676246627282 (+1 ms)Closed at 1676246627282 2023-02-13 00:03:47,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,285 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,286 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,288 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:47,289 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1 2023-02-13 00:03:47,289 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43a9c7b974b83e70fc6dd7e193f184f0 columnFamilyName f1 2023-02-13 00:03:47,294 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f1/testWithMapReduce=43a9c7b974b83e70fc6dd7e193f184f0-91dce44790824653a7cb57ddca6c29da 2023-02-13 00:03:47,294 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(310): Store=43a9c7b974b83e70fc6dd7e193f184f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,294 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43a9c7b974b83e70fc6dd7e193f184f0 2023-02-13 00:03:47,295 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2 2023-02-13 00:03:47,295 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43a9c7b974b83e70fc6dd7e193f184f0 columnFamilyName f2 2023-02-13 00:03:47,299 DEBUG [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/43a9c7b974b83e70fc6dd7e193f184f0/f2/testWithMapReduce=43a9c7b974b83e70fc6dd7e193f184f0-24be38a1264547b9a25dc0a6e887070e 2023-02-13 00:03:47,299 INFO [StoreOpener-43a9c7b974b83e70fc6dd7e193f184f0-1] regionserver.HStore(310): Store=43a9c7b974b83e70fc6dd7e193f184f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,300 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,300 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 43a9c7b974b83e70fc6dd7e193f184f0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72989356, jitterRate=0.08762615919113159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,300 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 43a9c7b974b83e70fc6dd7e193f184f0: Writing region info on filesystem at 1676246627286Initializing all the Stores at 1676246627287 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627287Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627287Region opened successfully at 1676246627300 (+13 ms) 2023-02-13 00:03:47,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 43a9c7b974b83e70fc6dd7e193f184f0, disabling compactions & flushes 2023-02-13 00:03:47,331 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:47,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:47,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. after waiting 0 ms 2023-02-13 00:03:47,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:47,332 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676246622072.43a9c7b974b83e70fc6dd7e193f184f0. 2023-02-13 00:03:47,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 43a9c7b974b83e70fc6dd7e193f184f0: Waiting for close lock at 1676246627331Disabling compacts and flushes for region at 1676246627331Disabling writes for close at 1676246627332 (+1 ms)Writing region close event to WAL at 1676246627332Closed at 1676246627332 2023-02-13 00:03:47,337 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,337 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,339 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,341 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:47,342 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1 2023-02-13 00:03:47,342 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619db296ff6d7014fd9ca553592788bf columnFamilyName f1 2023-02-13 00:03:47,347 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f1/testWithMapReduce=619db296ff6d7014fd9ca553592788bf-ac95ef5616d44f5fb510d9b6e9f40493 2023-02-13 00:03:47,348 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(310): Store=619db296ff6d7014fd9ca553592788bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,348 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 619db296ff6d7014fd9ca553592788bf 2023-02-13 00:03:47,349 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2 2023-02-13 00:03:47,349 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619db296ff6d7014fd9ca553592788bf columnFamilyName f2 2023-02-13 00:03:47,354 DEBUG [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/619db296ff6d7014fd9ca553592788bf/f2/testWithMapReduce=619db296ff6d7014fd9ca553592788bf-e9b90870e1274910aafbca487a730bb2 2023-02-13 00:03:47,354 INFO [StoreOpener-619db296ff6d7014fd9ca553592788bf-1] regionserver.HStore(310): Store=619db296ff6d7014fd9ca553592788bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,355 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 619db296ff6d7014fd9ca553592788bf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63341157, jitterRate=-0.05614320933818817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 619db296ff6d7014fd9ca553592788bf: Writing region info on filesystem at 1676246627339Initializing all the Stores at 1676246627340 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627340Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627340Region opened successfully at 1676246627355 (+15 ms) 2023-02-13 00:03:47,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 619db296ff6d7014fd9ca553592788bf, disabling compactions & flushes 2023-02-13 00:03:47,393 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:47,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:47,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. after waiting 0 ms 2023-02-13 00:03:47,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:47,395 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676246622072.619db296ff6d7014fd9ca553592788bf. 2023-02-13 00:03:47,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 619db296ff6d7014fd9ca553592788bf: Waiting for close lock at 1676246627393Disabling compacts and flushes for region at 1676246627393Disabling writes for close at 1676246627393Writing region close event to WAL at 1676246627395 (+2 ms)Closed at 1676246627395 2023-02-13 00:03:47,399 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,400 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,401 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,403 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:47,404 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1 2023-02-13 00:03:47,404 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81253aedf8d8cf083c1faf41738af691 columnFamilyName f1 2023-02-13 00:03:47,409 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f1/testWithMapReduce=81253aedf8d8cf083c1faf41738af691-87f9560224644cbd905ad282d80ec21d 2023-02-13 00:03:47,409 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(310): Store=81253aedf8d8cf083c1faf41738af691/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,409 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81253aedf8d8cf083c1faf41738af691 2023-02-13 00:03:47,410 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2 2023-02-13 00:03:47,411 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81253aedf8d8cf083c1faf41738af691 columnFamilyName f2 2023-02-13 00:03:47,415 DEBUG [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/81253aedf8d8cf083c1faf41738af691/f2/testWithMapReduce=81253aedf8d8cf083c1faf41738af691-a9a8f7724dcb41c1ae838078a239e6e8 2023-02-13 00:03:47,415 INFO [StoreOpener-81253aedf8d8cf083c1faf41738af691-1] regionserver.HStore(310): Store=81253aedf8d8cf083c1faf41738af691/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,415 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,415 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 81253aedf8d8cf083c1faf41738af691; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72871041, jitterRate=0.0858631283044815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,415 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 81253aedf8d8cf083c1faf41738af691: Writing region info on filesystem at 1676246627401Initializing all the Stores at 1676246627402 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627402Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627402Region opened successfully at 1676246627415 (+13 ms) 2023-02-13 00:03:47,443 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 81253aedf8d8cf083c1faf41738af691, disabling compactions & flushes 2023-02-13 00:03:47,443 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:47,443 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:47,443 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. after waiting 0 ms 2023-02-13 00:03:47,443 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:47,444 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676246622072.81253aedf8d8cf083c1faf41738af691. 2023-02-13 00:03:47,444 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 81253aedf8d8cf083c1faf41738af691: Waiting for close lock at 1676246627443Disabling compacts and flushes for region at 1676246627443Disabling writes for close at 1676246627443Writing region close event to WAL at 1676246627444 (+1 ms)Closed at 1676246627444 2023-02-13 00:03:47,447 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,447 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,450 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,452 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:47,453 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1 2023-02-13 00:03:47,453 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8135349477b19c3998d47bdb822690b5 columnFamilyName f1 2023-02-13 00:03:47,458 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f1/testWithMapReduce=8135349477b19c3998d47bdb822690b5-0f74c1b310e14db6a4d9103cc0556f46 2023-02-13 00:03:47,458 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(310): Store=8135349477b19c3998d47bdb822690b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,458 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8135349477b19c3998d47bdb822690b5 2023-02-13 00:03:47,459 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2 2023-02-13 00:03:47,459 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8135349477b19c3998d47bdb822690b5 columnFamilyName f2 2023-02-13 00:03:47,463 DEBUG [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/8135349477b19c3998d47bdb822690b5/f2/testWithMapReduce=8135349477b19c3998d47bdb822690b5-e17cb8023aa24abaa0c979528bd25d50 2023-02-13 00:03:47,464 INFO [StoreOpener-8135349477b19c3998d47bdb822690b5-1] regionserver.HStore(310): Store=8135349477b19c3998d47bdb822690b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,464 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8135349477b19c3998d47bdb822690b5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75348621, jitterRate=0.12278194725513458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8135349477b19c3998d47bdb822690b5: Writing region info on filesystem at 1676246627450Initializing all the Stores at 1676246627451 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627451Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627451Region opened successfully at 1676246627464 (+13 ms) 2023-02-13 00:03:47,492 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8135349477b19c3998d47bdb822690b5, disabling compactions & flushes 2023-02-13 00:03:47,492 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:47,492 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:47,492 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. after waiting 0 ms 2023-02-13 00:03:47,492 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:47,493 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676246622072.8135349477b19c3998d47bdb822690b5. 2023-02-13 00:03:47,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8135349477b19c3998d47bdb822690b5: Waiting for close lock at 1676246627492Disabling compacts and flushes for region at 1676246627492Disabling writes for close at 1676246627492Writing region close event to WAL at 1676246627493 (+1 ms)Closed at 1676246627493 2023-02-13 00:03:47,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,496 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,498 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,499 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:47,500 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1 2023-02-13 00:03:47,501 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9ea029dc149ace45c4f4c605a14834 columnFamilyName f1 2023-02-13 00:03:47,506 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f1/testWithMapReduce=9f9ea029dc149ace45c4f4c605a14834-f189bb34596b4cfaa7fe54267c5ff537 2023-02-13 00:03:47,506 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(310): Store=9f9ea029dc149ace45c4f4c605a14834/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,506 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f9ea029dc149ace45c4f4c605a14834 2023-02-13 00:03:47,507 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2 2023-02-13 00:03:47,507 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9ea029dc149ace45c4f4c605a14834 columnFamilyName f2 2023-02-13 00:03:47,512 DEBUG [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/9f9ea029dc149ace45c4f4c605a14834/f2/testWithMapReduce=9f9ea029dc149ace45c4f4c605a14834-e8f88d232f81453184d642f135db3645 2023-02-13 00:03:47,512 INFO [StoreOpener-9f9ea029dc149ace45c4f4c605a14834-1] regionserver.HStore(310): Store=9f9ea029dc149ace45c4f4c605a14834/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,512 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9f9ea029dc149ace45c4f4c605a14834; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72480964, jitterRate=0.080050528049469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9f9ea029dc149ace45c4f4c605a14834: Writing region info on filesystem at 1676246627498Initializing all the Stores at 1676246627498Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627499 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627499Region opened successfully at 1676246627512 (+13 ms) 2023-02-13 00:03:47,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9f9ea029dc149ace45c4f4c605a14834, disabling compactions & flushes 2023-02-13 00:03:47,547 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:47,548 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:47,548 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. after waiting 0 ms 2023-02-13 00:03:47,548 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:47,549 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676246622072.9f9ea029dc149ace45c4f4c605a14834. 2023-02-13 00:03:47,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9f9ea029dc149ace45c4f4c605a14834: Waiting for close lock at 1676246627547Disabling compacts and flushes for region at 1676246627547Disabling writes for close at 1676246627548 (+1 ms)Writing region close event to WAL at 1676246627549 (+1 ms)Closed at 1676246627549 2023-02-13 00:03:47,552 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,552 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,554 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,555 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:47,557 DEBUG [StoreOpener-85114851d4628826eb63d2a93ef50707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/f1 2023-02-13 00:03:47,558 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85114851d4628826eb63d2a93ef50707 columnFamilyName f1 2023-02-13 00:03:47,558 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(310): Store=85114851d4628826eb63d2a93ef50707/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,558 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85114851d4628826eb63d2a93ef50707 2023-02-13 00:03:47,560 DEBUG [StoreOpener-85114851d4628826eb63d2a93ef50707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/85114851d4628826eb63d2a93ef50707/f2 2023-02-13 00:03:47,560 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85114851d4628826eb63d2a93ef50707 columnFamilyName f2 2023-02-13 00:03:47,561 INFO [StoreOpener-85114851d4628826eb63d2a93ef50707-1] regionserver.HStore(310): Store=85114851d4628826eb63d2a93ef50707/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,561 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,561 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 85114851d4628826eb63d2a93ef50707; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69452383, jitterRate=0.034921154379844666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,561 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 85114851d4628826eb63d2a93ef50707: Writing region info on filesystem at 1676246627554Initializing all the Stores at 1676246627555 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627555Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627555Region opened successfully at 1676246627561 (+6 ms) 2023-02-13 00:03:47,585 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 85114851d4628826eb63d2a93ef50707, disabling compactions & flushes 2023-02-13 00:03:47,585 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:47,585 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:47,585 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. after waiting 0 ms 2023-02-13 00:03:47,585 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:47,586 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676246622072.85114851d4628826eb63d2a93ef50707. 2023-02-13 00:03:47,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 85114851d4628826eb63d2a93ef50707: Waiting for close lock at 1676246627585Disabling compacts and flushes for region at 1676246627585Disabling writes for close at 1676246627585Writing region close event to WAL at 1676246627586 (+1 ms)Closed at 1676246627586 2023-02-13 00:03:47,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,588 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,589 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,591 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:47,592 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1 2023-02-13 00:03:47,592 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 762f4c654acaee6df0e96477fa7381c4 columnFamilyName f1 2023-02-13 00:03:47,597 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f1/testWithMapReduce=762f4c654acaee6df0e96477fa7381c4-8f2e687df7054f8bbd7aea8606360712 2023-02-13 00:03:47,597 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(310): Store=762f4c654acaee6df0e96477fa7381c4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,597 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 762f4c654acaee6df0e96477fa7381c4 2023-02-13 00:03:47,598 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2 2023-02-13 00:03:47,598 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 762f4c654acaee6df0e96477fa7381c4 columnFamilyName f2 2023-02-13 00:03:47,603 DEBUG [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/762f4c654acaee6df0e96477fa7381c4/f2/testWithMapReduce=762f4c654acaee6df0e96477fa7381c4-1ae2a90ca3934ffc935b197a91a5f165 2023-02-13 00:03:47,603 INFO [StoreOpener-762f4c654acaee6df0e96477fa7381c4-1] regionserver.HStore(310): Store=762f4c654acaee6df0e96477fa7381c4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,603 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 762f4c654acaee6df0e96477fa7381c4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69033575, jitterRate=0.028680428862571716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 762f4c654acaee6df0e96477fa7381c4: Writing region info on filesystem at 1676246627590Initializing all the Stores at 1676246627590Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627590Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627591 (+1 ms)Region opened successfully at 1676246627603 (+12 ms) 2023-02-13 00:03:47,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 762f4c654acaee6df0e96477fa7381c4, disabling compactions & flushes 2023-02-13 00:03:47,631 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:47,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:47,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. after waiting 0 ms 2023-02-13 00:03:47,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:47,632 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676246622072.762f4c654acaee6df0e96477fa7381c4. 2023-02-13 00:03:47,632 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 762f4c654acaee6df0e96477fa7381c4: Waiting for close lock at 1676246627631Disabling compacts and flushes for region at 1676246627631Disabling writes for close at 1676246627631Writing region close event to WAL at 1676246627632 (+1 ms)Closed at 1676246627632 2023-02-13 00:03:47,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:47,635 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:47,636 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:47,638 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:47,639 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1 2023-02-13 00:03:47,640 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region baa6c7b62b7e293fa106c12fdd85618f columnFamilyName f1 2023-02-13 00:03:47,644 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f1/testWithMapReduce=baa6c7b62b7e293fa106c12fdd85618f-8a3cbc16b2a44d0ba98e4ccc64686964 2023-02-13 00:03:47,644 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(310): Store=baa6c7b62b7e293fa106c12fdd85618f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,644 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region baa6c7b62b7e293fa106c12fdd85618f 2023-02-13 00:03:47,645 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2 2023-02-13 00:03:47,646 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region baa6c7b62b7e293fa106c12fdd85618f columnFamilyName f2 2023-02-13 00:03:47,651 DEBUG [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(539): loaded hdfs://localhost:32903/user/jenkins/test-data/4038accd-3d3f-3b8d-abe7-e61b3a8bfbd3/testWithMapReduceAndOfflineHBaseMultiRegion/8ed42e6c-0386-4600-a3ff-7a0e1ce690ea/data/default/testWithMapReduce/baa6c7b62b7e293fa106c12fdd85618f/f2/testWithMapReduce=baa6c7b62b7e293fa106c12fdd85618f-ee05464773d74ac4a5ff0fee4c07b8cf 2023-02-13 00:03:47,651 INFO [StoreOpener-baa6c7b62b7e293fa106c12fdd85618f-1] regionserver.HStore(310): Store=baa6c7b62b7e293fa106c12fdd85618f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:47,651 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:47,652 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened baa6c7b62b7e293fa106c12fdd85618f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61464903, jitterRate=-0.08410157263278961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:47,652 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for baa6c7b62b7e293fa106c12fdd85618f: Writing region info on filesystem at 1676246627636Initializing all the Stores at 1676246627637 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627637Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246627637Region opened successfully at 1676246627652 (+15 ms) 2023-02-13 00:03:47,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing baa6c7b62b7e293fa106c12fdd85618f, disabling compactions & flushes 2023-02-13 00:03:47,683 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:47,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:47,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. after waiting 0 ms 2023-02-13 00:03:47,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:47,684 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676246622072.baa6c7b62b7e293fa106c12fdd85618f. 2023-02-13 00:03:47,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for baa6c7b62b7e293fa106c12fdd85618f: Waiting for close lock at 1676246627683Disabling compacts and flushes for region at 1676246627683Disabling writes for close at 1676246627683Writing region close event to WAL at 1676246627684 (+1 ms)Closed at 1676246627684 2023-02-13 00:03:48,194 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:03:48,195 WARN [Listener at localhost/38137] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:03:48,198 INFO [Listener at localhost/38137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:48,302 WARN [BP-1657025434-172.31.14.131-1676246619885 heartbeating to localhost/127.0.0.1:32903] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:03:48,302 WARN [BP-1657025434-172.31.14.131-1676246619885 heartbeating to localhost/127.0.0.1:32903] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1657025434-172.31.14.131-1676246619885 (Datanode Uuid 1f3c1c82-95c7-4f45-b177-4519ab52e67d) service to localhost/127.0.0.1:32903 2023-02-13 00:03:48,303 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/dfs/data/data3/current/BP-1657025434-172.31.14.131-1676246619885] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:48,303 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/dfs/data/data4/current/BP-1657025434-172.31.14.131-1676246619885] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:48,305 WARN [Listener at localhost/38137] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:03:48,310 INFO [Listener at localhost/38137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:48,415 WARN [BP-1657025434-172.31.14.131-1676246619885 heartbeating to localhost/127.0.0.1:32903] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:03:48,415 WARN [BP-1657025434-172.31.14.131-1676246619885 heartbeating to localhost/127.0.0.1:32903] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1657025434-172.31.14.131-1676246619885 (Datanode Uuid bc170a78-ab96-4482-8f77-131ffa3995c6) service to localhost/127.0.0.1:32903 2023-02-13 00:03:48,415 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/dfs/data/data1/current/BP-1657025434-172.31.14.131-1676246619885] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:48,416 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/cluster_43612530-571c-5274-5ceb-3483ef9ecfd1/dfs/data/data2/current/BP-1657025434-172.31.14.131-1676246619885] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:48,425 INFO [Listener at localhost/38137] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:48,545 INFO [Listener at localhost/38137] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:03:48,589 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:03:48,602 INFO [Listener at localhost/38137] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=156 (was 101) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:32903 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38137 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:32903 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:32903 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:32903 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32903 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:32903 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44265,1676246620495)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:32903 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=535 (was 531) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3955 (was 4131) 2023-02-13 00:03:48,612 INFO [Listener at localhost/38137] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=156, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=168, AvailableMemoryMB=3955 2023-02-13 00:03:48,622 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop.log.dir so I do NOT create it in target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35 2023-02-13 00:03:48,622 WARN [Listener at localhost/38137] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 00:03:48,622 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop.tmp.dir so I do NOT create it in target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35 2023-02-13 00:03:48,622 WARN [Listener at localhost/38137] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/163d40af-35f2-28dc-1954-b28e437d8736/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 00:03:48,622 DEBUG [Listener at localhost/38137] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35 2023-02-13 00:03:48,622 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f, deleteOnExit=true 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/test.cache.data in system properties and HBase conf 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:03:48,623 DEBUG [Listener at localhost/38137] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:03:48,623 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:03:48,624 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:48,625 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:03:48,625 INFO [Listener at localhost/38137] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:03:48,629 WARN [Listener at localhost/38137] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:48,629 WARN [Listener at localhost/38137] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:48,668 WARN [Listener at localhost/38137] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:48,670 INFO [Listener at localhost/38137] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:48,674 INFO [Listener at localhost/38137] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/java.io.tmpdir/Jetty_localhost_46213_hdfs____.nyv77o/webapp 2023-02-13 00:03:48,767 INFO [Listener at localhost/38137] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46213 2023-02-13 00:03:48,771 WARN [Listener at localhost/38137] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:48,771 WARN [Listener at localhost/38137] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:48,814 WARN [Listener at localhost/46395] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:48,831 WARN [Listener at localhost/46395] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:48,836 WARN [Listener at localhost/46395] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:48,837 INFO [Listener at localhost/46395] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:48,841 INFO [Listener at localhost/46395] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/java.io.tmpdir/Jetty_localhost_45581_datanode____nud1kk/webapp 2023-02-13 00:03:48,933 INFO [Listener at localhost/46395] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45581 2023-02-13 00:03:48,941 WARN [Listener at localhost/42137] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:48,959 WARN [Listener at localhost/42137] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:48,961 WARN [Listener at localhost/42137] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:48,963 INFO [Listener at localhost/42137] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:48,966 INFO [Listener at localhost/42137] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/java.io.tmpdir/Jetty_localhost_33477_datanode____.rc43mt/webapp 2023-02-13 00:03:49,050 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae337c9221373e06: Processing first storage report for DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e from datanode 11e481bd-8ee0-4a65-b460-2fc1f02b70f4 2023-02-13 00:03:49,050 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae337c9221373e06: from storage DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e node DatanodeRegistration(127.0.0.1:41975, datanodeUuid=11e481bd-8ee0-4a65-b460-2fc1f02b70f4, infoPort=35541, infoSecurePort=0, ipcPort=42137, storageInfo=lv=-57;cid=testClusterID;nsid=104221605;c=1676246628632), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:49,050 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae337c9221373e06: Processing first storage report for DS-02e9c0e9-70e6-4582-b05c-f761445c2dad from datanode 11e481bd-8ee0-4a65-b460-2fc1f02b70f4 2023-02-13 00:03:49,050 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae337c9221373e06: from storage DS-02e9c0e9-70e6-4582-b05c-f761445c2dad node DatanodeRegistration(127.0.0.1:41975, datanodeUuid=11e481bd-8ee0-4a65-b460-2fc1f02b70f4, infoPort=35541, infoSecurePort=0, ipcPort=42137, storageInfo=lv=-57;cid=testClusterID;nsid=104221605;c=1676246628632), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:49,078 INFO [Listener at localhost/42137] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33477 2023-02-13 00:03:49,087 WARN [Listener at localhost/36263] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:49,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b07a7796930f505: Processing first storage report for DS-61290bfb-0db8-40ca-8838-0d9358162796 from datanode 1ca88f07-d2e7-4bb0-a2e2-07cc26b9735c 2023-02-13 00:03:49,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b07a7796930f505: from storage DS-61290bfb-0db8-40ca-8838-0d9358162796 node DatanodeRegistration(127.0.0.1:38465, datanodeUuid=1ca88f07-d2e7-4bb0-a2e2-07cc26b9735c, infoPort=36105, infoSecurePort=0, ipcPort=36263, storageInfo=lv=-57;cid=testClusterID;nsid=104221605;c=1676246628632), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:49,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b07a7796930f505: Processing first storage report for DS-70baffc6-9cdd-41f1-8a6b-7b020ddc9441 from datanode 1ca88f07-d2e7-4bb0-a2e2-07cc26b9735c 2023-02-13 00:03:49,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b07a7796930f505: from storage DS-70baffc6-9cdd-41f1-8a6b-7b020ddc9441 node DatanodeRegistration(127.0.0.1:38465, datanodeUuid=1ca88f07-d2e7-4bb0-a2e2-07cc26b9735c, infoPort=36105, infoSecurePort=0, ipcPort=36263, storageInfo=lv=-57;cid=testClusterID;nsid=104221605;c=1676246628632), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:49,199 DEBUG [Listener at localhost/36263] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35 2023-02-13 00:03:49,201 INFO [Listener at localhost/36263] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/zookeeper_0, clientPort=64193, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:03:49,202 INFO [Listener at localhost/36263] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64193 2023-02-13 00:03:49,203 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,204 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,216 INFO [Listener at localhost/36263] util.FSUtils(479): Created version file at hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2 with version=8 2023-02-13 00:03:49,216 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,217 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,218 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46395/user/jenkins/test-data/1e4bdc81-8899-34d9-9c3d-0de979f8e976/hbase-staging 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:49,220 INFO [Listener at localhost/36263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:49,221 INFO [Listener at localhost/36263] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39135 2023-02-13 00:03:49,222 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,223 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,223 INFO [Listener at localhost/36263] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39135 connecting to ZooKeeper ensemble=127.0.0.1:64193 2023-02-13 00:03:49,234 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:391350x0, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:49,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39135-0x1004afda5160000 connected 2023-02-13 00:03:49,255 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:49,255 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:49,255 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:49,256 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39135 2023-02-13 00:03:49,256 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39135 2023-02-13 00:03:49,260 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39135 2023-02-13 00:03:49,260 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39135 2023-02-13 00:03:49,260 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39135 2023-02-13 00:03:49,261 INFO [Listener at localhost/36263] master.HMaster(439): hbase.rootdir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2, hbase.cluster.distributed=false 2023-02-13 00:03:49,273 INFO [Listener at localhost/36263] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:49,273 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,273 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,273 INFO [Listener at localhost/36263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:49,273 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,273 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:49,274 INFO [Listener at localhost/36263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:49,275 INFO [Listener at localhost/36263] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41683 2023-02-13 00:03:49,276 INFO [Listener at localhost/36263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:49,276 DEBUG [Listener at localhost/36263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:49,277 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,278 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,279 INFO [Listener at localhost/36263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41683 connecting to ZooKeeper ensemble=127.0.0.1:64193 2023-02-13 00:03:49,282 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:416830x0, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:49,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41683-0x1004afda5160001 connected 2023-02-13 00:03:49,283 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:49,284 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:49,284 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:49,288 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41683 2023-02-13 00:03:49,288 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41683 2023-02-13 00:03:49,288 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41683 2023-02-13 00:03:49,290 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41683 2023-02-13 00:03:49,290 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41683 2023-02-13 00:03:49,301 INFO [Listener at localhost/36263] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:49,301 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,301 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,302 INFO [Listener at localhost/36263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:49,302 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:49,302 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:49,302 INFO [Listener at localhost/36263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:49,307 INFO [Listener at localhost/36263] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41321 2023-02-13 00:03:49,307 INFO [Listener at localhost/36263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:49,308 DEBUG [Listener at localhost/36263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:49,308 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,309 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,310 INFO [Listener at localhost/36263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41321 connecting to ZooKeeper ensemble=127.0.0.1:64193 2023-02-13 00:03:49,313 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:413210x0, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:49,316 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:413210x0, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:49,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41321-0x1004afda5160002 connected 2023-02-13 00:03:49,317 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:49,318 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:49,319 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41321 2023-02-13 00:03:49,320 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41321 2023-02-13 00:03:49,322 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41321 2023-02-13 00:03:49,324 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41321 2023-02-13 00:03:49,324 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41321 2023-02-13 00:03:49,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,327 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:49,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,329 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:49,329 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:49,330 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:49,330 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:49,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39135,1676246629219 from backup master directory 2023-02-13 00:03:49,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:49,333 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,333 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:49,333 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:49,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/hbase.id with ID: 5d50fe1c-0faa-4297-8546-13f6228ebfce 2023-02-13 00:03:49,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:49,358 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4bbe974f to 127.0.0.1:64193 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:49,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b273290, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:49,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:49,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:03:49,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:49,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store-tmp 2023-02-13 00:03:49,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:49,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:49,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:49,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:49,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:49,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:49,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:49,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246629418Disabling compacts and flushes for region at 1676246629418Disabling writes for close at 1676246629418Writing region close event to WAL at 1676246629418Closed at 1676246629418 2023-02-13 00:03:49,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/WALs/jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39135%2C1676246629219, suffix=, logDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/WALs/jenkins-hbase4.apache.org,39135,1676246629219, archiveDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/oldWALs, maxLogs=10 2023-02-13 00:03:49,438 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK] 2023-02-13 00:03:49,438 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK] 2023-02-13 00:03:49,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/WALs/jenkins-hbase4.apache.org,39135,1676246629219/jenkins-hbase4.apache.org%2C39135%2C1676246629219.1676246629422 2023-02-13 00:03:49,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK], DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK]] 2023-02-13 00:03:49,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:49,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:49,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:49,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:49,446 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:49,447 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:03:49,447 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:03:49,448 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:49,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:49,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:49,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:49,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71932093, jitterRate=0.07187171280384064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:49,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246629445Initializing all the Stores at 1676246629446 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246629446Cleaning up temporary data from old regions at 1676246629449 (+3 ms)Cleaning up detritus from prior splits at 1676246629450 (+1 ms)Region opened successfully at 1676246629455 (+5 ms) 2023-02-13 00:03:49,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:03:49,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:03:49,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:03:49,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:03:49,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 00:03:49,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 00:03:49,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:03:49,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:03:49,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:03:49,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:03:49,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:03:49,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:03:49,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:03:49,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:03:49,478 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:03:49,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:03:49,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:03:49,480 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:49,480 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:49,480 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:49,480 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39135,1676246629219, sessionid=0x1004afda5160000, setting cluster-up flag (Was=false) 2023-02-13 00:03:49,485 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:03:49,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,494 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:03:49,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:49,499 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.hbase-snapshot/.tmp 2023-02-13 00:03:49,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:49,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246659503 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:03:49,503 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:49,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,504 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:03:49,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:03:49,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:03:49,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:03:49,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:03:49,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:03:49,505 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:49,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246629505,5,FailOnTimeoutGroup] 2023-02-13 00:03:49,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246629509,5,FailOnTimeoutGroup] 2023-02-13 00:03:49,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:03:49,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,523 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:49,523 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:49,524 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2 2023-02-13 00:03:49,526 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(952): ClusterId : 5d50fe1c-0faa-4297-8546-13f6228ebfce 2023-02-13 00:03:49,526 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(952): ClusterId : 5d50fe1c-0faa-4297-8546-13f6228ebfce 2023-02-13 00:03:49,527 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:49,527 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:49,530 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:49,530 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:49,530 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:49,530 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:49,532 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:49,532 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:49,537 DEBUG [RS:0;jenkins-hbase4:41683] zookeeper.ReadOnlyZKClient(139): Connect 0x318ec7d2 to 127.0.0.1:64193 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:49,537 DEBUG [RS:1;jenkins-hbase4:41321] zookeeper.ReadOnlyZKClient(139): Connect 0x6a76658c to 127.0.0.1:64193 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:49,542 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:49,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:49,544 DEBUG [RS:1;jenkins-hbase4:41321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b196b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:49,544 DEBUG [RS:0;jenkins-hbase4:41683] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f493f93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:49,544 DEBUG [RS:1;jenkins-hbase4:41321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@608e0efc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:49,544 DEBUG [RS:0;jenkins-hbase4:41683] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b76aca2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:49,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/info 2023-02-13 00:03:49,545 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:49,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:49,547 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:49,548 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:49,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:49,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/table 2023-02-13 00:03:49,550 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:49,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,551 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740 2023-02-13 00:03:49,551 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740 2023-02-13 00:03:49,553 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:49,554 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41683 2023-02-13 00:03:49,554 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41321 2023-02-13 00:03:49,554 INFO [RS:0;jenkins-hbase4:41683] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:49,554 INFO [RS:1;jenkins-hbase4:41321] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:49,554 INFO [RS:1;jenkins-hbase4:41321] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:49,554 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:49,554 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:49,554 INFO [RS:0;jenkins-hbase4:41683] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:49,554 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:49,555 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39135,1676246629219 with isa=jenkins-hbase4.apache.org/172.31.14.131:41321, startcode=1676246629301 2023-02-13 00:03:49,555 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39135,1676246629219 with isa=jenkins-hbase4.apache.org/172.31.14.131:41683, startcode=1676246629273 2023-02-13 00:03:49,556 DEBUG [RS:1;jenkins-hbase4:41321] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:49,556 DEBUG [RS:0;jenkins-hbase4:41683] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:49,558 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34495, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:49,558 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59521, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:49,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39135] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,560 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:49,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,561 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2 2023-02-13 00:03:49,561 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46395 2023-02-13 00:03:49,561 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75095471, jitterRate=0.11900971829891205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:49,561 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2 2023-02-13 00:03:49,561 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:49,561 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46395 2023-02-13 00:03:49,561 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:49,561 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246629542Initializing all the Stores at 1676246629543 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246629543Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246629543Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246629543Cleaning up temporary data from old regions at 1676246629552 (+9 ms)Cleaning up detritus from prior splits at 1676246629552Region opened successfully at 1676246629561 (+9 ms) 2023-02-13 00:03:49,562 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:49,562 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:49,562 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:49,562 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:49,562 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:49,562 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:49,562 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246629562Disabling compacts and flushes for region at 1676246629562Disabling writes for close at 1676246629562Writing region close event to WAL at 1676246629562Closed at 1676246629562 2023-02-13 00:03:49,563 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:49,563 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:03:49,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:03:49,565 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:03:49,566 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:49,567 DEBUG [RS:0;jenkins-hbase4:41683] zookeeper.ZKUtil(162): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,567 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:03:49,568 WARN [RS:0;jenkins-hbase4:41683] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:49,568 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41321,1676246629301] 2023-02-13 00:03:49,568 INFO [RS:0;jenkins-hbase4:41683] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:49,568 DEBUG [RS:1;jenkins-hbase4:41321] zookeeper.ZKUtil(162): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,568 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,568 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41683,1676246629273] 2023-02-13 00:03:49,568 WARN [RS:1;jenkins-hbase4:41321] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:49,568 INFO [RS:1;jenkins-hbase4:41321] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:49,568 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,574 DEBUG [RS:0;jenkins-hbase4:41683] zookeeper.ZKUtil(162): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,574 DEBUG [RS:1;jenkins-hbase4:41321] zookeeper.ZKUtil(162): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,574 DEBUG [RS:0;jenkins-hbase4:41683] zookeeper.ZKUtil(162): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,575 DEBUG [RS:1;jenkins-hbase4:41321] zookeeper.ZKUtil(162): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,575 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:49,575 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:49,576 INFO [RS:0;jenkins-hbase4:41683] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:49,576 INFO [RS:1;jenkins-hbase4:41321] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:49,577 INFO [RS:0;jenkins-hbase4:41683] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:49,578 INFO [RS:0;jenkins-hbase4:41683] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:49,578 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,578 INFO [RS:1;jenkins-hbase4:41321] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:49,580 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:49,581 INFO [RS:1;jenkins-hbase4:41321] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:49,581 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,582 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:49,583 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,583 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,583 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,583 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,583 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:49,584 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,584 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:0;jenkins-hbase4:41683] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,584 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,588 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,588 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,588 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,588 DEBUG [RS:1;jenkins-hbase4:41321] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:49,589 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,589 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,589 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,599 INFO [RS:0;jenkins-hbase4:41683] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:49,600 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41683,1676246629273-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,600 INFO [RS:1;jenkins-hbase4:41321] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:49,600 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41321,1676246629301-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,611 INFO [RS:1;jenkins-hbase4:41321] regionserver.Replication(203): jenkins-hbase4.apache.org,41321,1676246629301 started 2023-02-13 00:03:49,611 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41321,1676246629301, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41321, sessionid=0x1004afda5160002 2023-02-13 00:03:49,612 INFO [RS:0;jenkins-hbase4:41683] regionserver.Replication(203): jenkins-hbase4.apache.org,41683,1676246629273 started 2023-02-13 00:03:49,612 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:49,612 DEBUG [RS:1;jenkins-hbase4:41321] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,612 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41683,1676246629273, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41683, sessionid=0x1004afda5160001 2023-02-13 00:03:49,612 DEBUG [RS:1;jenkins-hbase4:41321] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41321,1676246629301' 2023-02-13 00:03:49,612 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:49,612 DEBUG [RS:0;jenkins-hbase4:41683] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,612 DEBUG [RS:0;jenkins-hbase4:41683] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41683,1676246629273' 2023-02-13 00:03:49,612 DEBUG [RS:0;jenkins-hbase4:41683] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:49,612 DEBUG [RS:1;jenkins-hbase4:41321] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:49,612 DEBUG [RS:0;jenkins-hbase4:41683] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:49,613 DEBUG [RS:1;jenkins-hbase4:41321] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:49,613 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:49,613 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:49,613 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:49,613 DEBUG [RS:1;jenkins-hbase4:41321] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,613 DEBUG [RS:1;jenkins-hbase4:41321] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41321,1676246629301' 2023-02-13 00:03:49,613 DEBUG [RS:1;jenkins-hbase4:41321] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:49,613 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:49,613 DEBUG [RS:0;jenkins-hbase4:41683] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:49,613 DEBUG [RS:0;jenkins-hbase4:41683] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41683,1676246629273' 2023-02-13 00:03:49,613 DEBUG [RS:0;jenkins-hbase4:41683] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:49,614 DEBUG [RS:0;jenkins-hbase4:41683] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:49,614 DEBUG [RS:1;jenkins-hbase4:41321] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:49,614 DEBUG [RS:0;jenkins-hbase4:41683] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:49,614 DEBUG [RS:1;jenkins-hbase4:41321] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:49,614 INFO [RS:1;jenkins-hbase4:41321] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:49,614 INFO [RS:1;jenkins-hbase4:41321] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:49,614 INFO [RS:0;jenkins-hbase4:41683] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:49,614 INFO [RS:0;jenkins-hbase4:41683] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:49,718 DEBUG [jenkins-hbase4:39135] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:03:49,718 DEBUG [jenkins-hbase4:39135] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:49,720 DEBUG [jenkins-hbase4:39135] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:49,720 DEBUG [jenkins-hbase4:39135] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:49,720 DEBUG [jenkins-hbase4:39135] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:49,721 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41321,1676246629301, state=OPENING 2023-02-13 00:03:49,722 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:03:49,723 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:49,723 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:49,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41321,1676246629301}] 2023-02-13 00:03:49,878 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:49,878 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:49,880 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:49,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:03:49,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:49,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41321%2C1676246629301.meta, suffix=.meta, logDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41321,1676246629301, archiveDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/oldWALs, maxLogs=32 2023-02-13 00:03:49,902 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK] 2023-02-13 00:03:49,902 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK] 2023-02-13 00:03:49,903 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41321,1676246629301/jenkins-hbase4.apache.org%2C41321%2C1676246629301.meta.1676246629887.meta 2023-02-13 00:03:49,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK], DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK]] 2023-02-13 00:03:49,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:49,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:03:49,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:03:49,904 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:03:49,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:03:49,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:49,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:03:49,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:03:49,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:49,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/info 2023-02-13 00:03:49,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/info 2023-02-13 00:03:49,907 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:49,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:49,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:49,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:49,909 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:49,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:49,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/table 2023-02-13 00:03:49,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/table 2023-02-13 00:03:49,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:49,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:49,912 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740 2023-02-13 00:03:49,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740 2023-02-13 00:03:49,916 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:49,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:49,918 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69024122, jitterRate=0.028539568185806274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:49,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246629905Writing region info on filesystem at 1676246629905Initializing all the Stores at 1676246629905Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246629906 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246629906Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246629906Cleaning up temporary data from old regions at 1676246629914 (+8 ms)Cleaning up detritus from prior splits at 1676246629915 (+1 ms)Running coprocessor post-open hooks at 1676246629918 (+3 ms)Region opened successfully at 1676246629918 2023-02-13 00:03:49,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246629878 2023-02-13 00:03:49,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:03:49,923 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:03:49,923 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41321,1676246629301, state=OPEN 2023-02-13 00:03:49,926 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:03:49,926 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:49,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:03:49,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41321,1676246629301 in 203 msec 2023-02-13 00:03:49,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:03:49,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-13 00:03:49,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 430 msec 2023-02-13 00:03:49,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246629327, completionTime=-1 2023-02-13 00:03:49,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:03:49,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:03:49,935 DEBUG [hconnection-0x23b656b2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:49,936 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:49,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:03:49,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246689938 2023-02-13 00:03:49,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246749938 2023-02-13 00:03:49,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39135,1676246629219-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39135,1676246629219-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39135,1676246629219-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39135, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:03:49,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:49,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:03:49,948 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:03:49,949 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:49,950 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:49,951 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:49,952 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7 empty. 2023-02-13 00:03:49,952 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:49,952 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:03:49,962 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:49,963 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b5ac5554fbd2517c583c1383143fadc7, NAME => 'hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp 2023-02-13 00:03:49,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:49,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b5ac5554fbd2517c583c1383143fadc7, disabling compactions & flushes 2023-02-13 00:03:49,970 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:49,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:49,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. after waiting 0 ms 2023-02-13 00:03:49,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:49,970 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:49,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b5ac5554fbd2517c583c1383143fadc7: Waiting for close lock at 1676246629970Disabling compacts and flushes for region at 1676246629970Disabling writes for close at 1676246629970Writing region close event to WAL at 1676246629970Closed at 1676246629970 2023-02-13 00:03:49,972 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:49,973 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246629973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246629973"}]},"ts":"1676246629973"} 2023-02-13 00:03:49,975 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:03:49,976 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:49,976 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246629976"}]},"ts":"1676246629976"} 2023-02-13 00:03:49,977 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:03:49,981 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:49,982 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:49,982 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:49,982 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:49,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b5ac5554fbd2517c583c1383143fadc7, ASSIGN}] 2023-02-13 00:03:49,985 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b5ac5554fbd2517c583c1383143fadc7, ASSIGN 2023-02-13 00:03:49,985 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b5ac5554fbd2517c583c1383143fadc7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41683,1676246629273; forceNewPlan=false, retain=false 2023-02-13 00:03:50,136 INFO [jenkins-hbase4:39135] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:03:50,137 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b5ac5554fbd2517c583c1383143fadc7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:50,137 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246630137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246630137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246630137"}]},"ts":"1676246630137"} 2023-02-13 00:03:50,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b5ac5554fbd2517c583c1383143fadc7, server=jenkins-hbase4.apache.org,41683,1676246629273}] 2023-02-13 00:03:50,291 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:50,292 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:50,293 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:50,298 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:50,299 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41683%2C1676246629273, suffix=, logDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41683,1676246629273, archiveDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/oldWALs, maxLogs=32 2023-02-13 00:03:50,316 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK] 2023-02-13 00:03:50,316 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK] 2023-02-13 00:03:50,318 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41683,1676246629273/jenkins-hbase4.apache.org%2C41683%2C1676246629273.1676246630300 2023-02-13 00:03:50,318 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK], DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK]] 2023-02-13 00:03:50,318 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b5ac5554fbd2517c583c1383143fadc7, NAME => 'hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:50,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:50,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,320 INFO [StoreOpener-b5ac5554fbd2517c583c1383143fadc7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,321 DEBUG [StoreOpener-b5ac5554fbd2517c583c1383143fadc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/info 2023-02-13 00:03:50,321 DEBUG [StoreOpener-b5ac5554fbd2517c583c1383143fadc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/info 2023-02-13 00:03:50,321 INFO [StoreOpener-b5ac5554fbd2517c583c1383143fadc7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5ac5554fbd2517c583c1383143fadc7 columnFamilyName info 2023-02-13 00:03:50,322 INFO [StoreOpener-b5ac5554fbd2517c583c1383143fadc7-1] regionserver.HStore(310): Store=b5ac5554fbd2517c583c1383143fadc7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:50,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,325 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:50,326 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:50,327 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b5ac5554fbd2517c583c1383143fadc7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70670909, jitterRate=0.053078606724739075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:50,327 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b5ac5554fbd2517c583c1383143fadc7: Running coprocessor pre-open hook at 1676246630319Writing region info on filesystem at 1676246630319Initializing all the Stores at 1676246630319Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246630319Cleaning up temporary data from old regions at 1676246630323 (+4 ms)Cleaning up detritus from prior splits at 1676246630323Running coprocessor post-open hooks at 1676246630327 (+4 ms)Region opened successfully at 1676246630327 2023-02-13 00:03:50,328 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7., pid=6, masterSystemTime=1676246630291 2023-02-13 00:03:50,330 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:50,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:50,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b5ac5554fbd2517c583c1383143fadc7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:50,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246630331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246630331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246630331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246630331"}]},"ts":"1676246630331"} 2023-02-13 00:03:50,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:03:50,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b5ac5554fbd2517c583c1383143fadc7, server=jenkins-hbase4.apache.org,41683,1676246629273 in 194 msec 2023-02-13 00:03:50,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:03:50,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b5ac5554fbd2517c583c1383143fadc7, ASSIGN in 352 msec 2023-02-13 00:03:50,336 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:50,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246630336"}]},"ts":"1676246630336"} 2023-02-13 00:03:50,338 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:03:50,340 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:50,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 394 msec 2023-02-13 00:03:50,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:03:50,350 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:50,350 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:50,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:50,354 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:50,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:03:50,363 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:50,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-13 00:03:50,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:03:50,383 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:50,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 00:03:50,391 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:03:50,393 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:03:50,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.060sec 2023-02-13 00:03:50,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:03:50,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:03:50,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:03:50,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39135,1676246629219-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:03:50,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39135,1676246629219-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:03:50,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:03:50,427 DEBUG [Listener at localhost/36263] zookeeper.ReadOnlyZKClient(139): Connect 0x5e8d7147 to 127.0.0.1:64193 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:50,432 DEBUG [Listener at localhost/36263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45ce2595, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:50,433 DEBUG [hconnection-0x6532470-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:50,435 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:50,437 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:50,437 DEBUG [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:03:50,439 DEBUG [Listener at localhost/36263] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:03:50,440 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:03:50,441 INFO [Listener at localhost/36263] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:50,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:50,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:03:50,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:55128 deadline: 1676246690441, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:50,442 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 00:03:50,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:50,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:50,446 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:50,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-13 00:03:50,447 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:50,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:50,449 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,449 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d empty. 2023-02-13 00:03:50,449 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,449 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 00:03:50,458 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:50,459 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => ca8b69f39aba0af281426b9b403ea10d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp 2023-02-13 00:03:50,470 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:50,470 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing ca8b69f39aba0af281426b9b403ea10d, disabling compactions & flushes 2023-02-13 00:03:50,470 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,470 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,470 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. after waiting 0 ms 2023-02-13 00:03:50,471 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,471 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,471 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for ca8b69f39aba0af281426b9b403ea10d: Waiting for close lock at 1676246630470Disabling compacts and flushes for region at 1676246630470Disabling writes for close at 1676246630471 (+1 ms)Writing region close event to WAL at 1676246630471Closed at 1676246630471 2023-02-13 00:03:50,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:50,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676246630473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246630473"}]},"ts":"1676246630473"} 2023-02-13 00:03:50,475 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:03:50,476 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:50,476 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246630476"}]},"ts":"1676246630476"} 2023-02-13 00:03:50,477 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-13 00:03:50,483 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:50,484 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:50,484 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:50,484 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:50,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, ASSIGN}] 2023-02-13 00:03:50,486 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, ASSIGN 2023-02-13 00:03:50,487 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41683,1676246629273; forceNewPlan=false, retain=false 2023-02-13 00:03:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:50,616 INFO [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41321%2C1676246629301, suffix=, logDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41321,1676246629301, archiveDir=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/oldWALs, maxLogs=32 2023-02-13 00:03:50,632 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK] 2023-02-13 00:03:50,632 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK] 2023-02-13 00:03:50,634 INFO [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/WALs/jenkins-hbase4.apache.org,41321,1676246629301/jenkins-hbase4.apache.org%2C41321%2C1676246629301.1676246630617 2023-02-13 00:03:50,634 DEBUG [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38465,DS-61290bfb-0db8-40ca-8838-0d9358162796,DISK], DatanodeInfoWithStorage[127.0.0.1:41975,DS-383d79e0-4497-4cb1-8db2-b5cfbe9eea9e,DISK]] 2023-02-13 00:03:50,637 INFO [jenkins-hbase4:39135] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:03:50,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ca8b69f39aba0af281426b9b403ea10d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:50,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676246630638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246630638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246630638"}]},"ts":"1676246630638"} 2023-02-13 00:03:50,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ca8b69f39aba0af281426b9b403ea10d, server=jenkins-hbase4.apache.org,41683,1676246629273}] 2023-02-13 00:03:50,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:50,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ca8b69f39aba0af281426b9b403ea10d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:50,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:50,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,797 INFO [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,798 DEBUG [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1 2023-02-13 00:03:50,798 DEBUG [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1 2023-02-13 00:03:50,798 INFO [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca8b69f39aba0af281426b9b403ea10d columnFamilyName f1 2023-02-13 00:03:50,799 INFO [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] regionserver.HStore(310): Store=ca8b69f39aba0af281426b9b403ea10d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:50,799 INFO [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,800 DEBUG [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2 2023-02-13 00:03:50,800 DEBUG [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2 2023-02-13 00:03:50,800 INFO [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca8b69f39aba0af281426b9b403ea10d columnFamilyName f2 2023-02-13 00:03:50,800 INFO [StoreOpener-ca8b69f39aba0af281426b9b403ea10d-1] regionserver.HStore(310): Store=ca8b69f39aba0af281426b9b403ea10d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:50,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:50,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:50,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:50,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ca8b69f39aba0af281426b9b403ea10d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71429015, jitterRate=0.06437526643276215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:50,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ca8b69f39aba0af281426b9b403ea10d: Running coprocessor pre-open hook at 1676246630796Writing region info on filesystem at 1676246630796Initializing all the Stores at 1676246630796Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246630796Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246630797 (+1 ms)Cleaning up temporary data from old regions at 1676246630802 (+5 ms)Cleaning up detritus from prior splits at 1676246630802Running coprocessor post-open hooks at 1676246630807 (+5 ms)Region opened successfully at 1676246630807 2023-02-13 00:03:50,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d., pid=12, masterSystemTime=1676246630792 2023-02-13 00:03:50,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:50,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ca8b69f39aba0af281426b9b403ea10d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:50,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676246630810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246630810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246630810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246630810"}]},"ts":"1676246630810"} 2023-02-13 00:03:50,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 00:03:50,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ca8b69f39aba0af281426b9b403ea10d, server=jenkins-hbase4.apache.org,41683,1676246629273 in 171 msec 2023-02-13 00:03:50,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 00:03:50,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, ASSIGN in 328 msec 2023-02-13 00:03:50,815 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:50,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246630815"}]},"ts":"1676246630815"} 2023-02-13 00:03:50,816 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-13 00:03:50,818 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:50,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 374 msec 2023-02-13 00:03:50,988 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 00:03:51,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:51,055 INFO [Listener at localhost/36263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-13 00:03:51,055 DEBUG [Listener at localhost/36263] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-13 00:03:51,056 INFO [Listener at localhost/36263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:51,058 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-13 00:03:51,058 INFO [Listener at localhost/36263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:51,058 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-13 00:03:51,058 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:03:51,088 DEBUG [hconnection-0x6532470-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:51,102 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60252, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:51,113 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41683] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,261 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:03:51,261 INFO [Listener at localhost/36263] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:03:51,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 00:03:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246631263 (current time:1676246631263). 2023-02-13 00:03:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:03:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] zookeeper.ReadOnlyZKClient(139): Connect 0x0b3965e1 to 127.0.0.1:64193 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:51,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9095bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:51,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:51,271 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37140, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b3965e1 to 127.0.0.1:64193 2023-02-13 00:03:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:03:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 00:03:51,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 00:03:51,276 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 00:03:51,277 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676247231277 2023-02-13 00:03:51,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 00:03:51,280 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,281 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 00:03:51,281 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:51,282 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:03:51,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 00:03:51,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 7 msec 2023-02-13 00:03:51,283 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 00:03:51,284 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676247231284 2023-02-13 00:03:51,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 00:03:51,304 INFO [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 00:03:51,304 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:51,305 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 00:03:51,305 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 00:03:51,305 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,305 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,307 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:51,307 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:51,307 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:51,307 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,307 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 00:03:51,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 00:03:51,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 00:03:51,316 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 00:03:51,316 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:51,316 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 00:03:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 00:03:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 00:03:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 00:03:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41321,1676246629301' joining acquired barrier for procedure (foo) in zk 2023-02-13 00:03:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 00:03:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41683,1676246629273' joining acquired barrier for procedure (foo) in zk 2023-02-13 00:03:51,319 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,319 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,319 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:51,320 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,320 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:51,320 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,320 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:03:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:51,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41683,1676246629273' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 00:03:51,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dff7eaa[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:51,322 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 00:03:51,322 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,323 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 00:03:51,323 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 00:03:51,323 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,323 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:51,323 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 00:03:51,323 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 00:03:51,323 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,323 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:51,324 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. started... 2023-02-13 00:03:51,323 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41321,1676246629301' in zk 2023-02-13 00:03:51,324 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ca8b69f39aba0af281426b9b403ea10d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 00:03:51,327 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 00:03:51,327 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:51,327 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 00:03:51,350 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f1/ac50a1f2cc42453581a939e1de608627 2023-02-13 00:03:51,371 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f2/9e73a49d60a940fc8d26da516a6f234f 2023-02-13 00:03:51,378 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f1/ac50a1f2cc42453581a939e1de608627 as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/ac50a1f2cc42453581a939e1de608627 2023-02-13 00:03:51,382 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:51,383 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/ac50a1f2cc42453581a939e1de608627, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:03:51,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 00:03:51,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:51,384 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:03:51,384 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f2/9e73a49d60a940fc8d26da516a6f234f as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/9e73a49d60a940fc8d26da516a6f234f 2023-02-13 00:03:51,391 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/9e73a49d60a940fc8d26da516a6f234f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:03:51,392 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ca8b69f39aba0af281426b9b403ea10d in 68ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:51,392 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 00:03:51,392 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ca8b69f39aba0af281426b9b403ea10d: 2023-02-13 00:03:51,393 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.' region-info for snapshot=foo 2023-02-13 00:03:51,393 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:51,393 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/ac50a1f2cc42453581a939e1de608627] hfiles 2023-02-13 00:03:51,393 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/ac50a1f2cc42453581a939e1de608627 for snapshot=foo 2023-02-13 00:03:51,393 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/9e73a49d60a940fc8d26da516a6f234f] hfiles 2023-02-13 00:03:51,393 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/9e73a49d60a940fc8d26da516a6f234f for snapshot=foo 2023-02-13 00:03:51,402 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. completed. 2023-02-13 00:03:51,402 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,402 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 00:03:51,402 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 00:03:51,402 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,402 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 00:03:51,402 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41683,1676246629273' in zk 2023-02-13 00:03:51,404 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,404 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 00:03:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:51,404 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:51,404 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 00:03:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:03:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:03:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41683,1676246629273': 2023-02-13 00:03:51,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41683,1676246629273' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 00:03:51,408 INFO [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 00:03:51,408 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:51,408 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:51,408 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 00:03:51,408 INFO [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:03:51,410 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:51,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:51,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:51,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:51,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:51,411 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:03:51,411 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:03:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,413 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:51,413 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:03:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,419 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,419 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:51,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:51,419 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:51,419 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:51,419 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:51,420 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,420 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:51,420 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 00:03:51,420 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 00:03:51,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 00:03:51,420 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:51,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:51,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:51,421 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,421 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,421 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:51,421 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:03:51,421 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:03:51,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.hbase-snapshot/.tmp/foo 2023-02-13 00:03:51,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:51,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.hbase-snapshot/.tmp/foo to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.hbase-snapshot/foo 2023-02-13 00:03:51,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-13 00:03:51,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.hbase-snapshot/.tmp/foo 2023-02-13 00:03:51,463 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.hbase-snapshot/.tmp/foo 2023-02-13 00:03:51,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676246631280Consolidate snapshot: foo at 1676246631420 (+140 ms)Loading Region manifests for foo at 1676246631421 (+1 ms)Writing data manifest for foo at 1676246631424 (+3 ms)Verifying snapshot: foo at 1676246631435 (+11 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676246631462 (+27 ms) 2023-02-13 00:03:51,465 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 00:03:51,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 184 msec 2023-02-13 00:03:51,584 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 00:03:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:03:51,586 INFO [Listener at localhost/36263] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:03:51,591 INFO [Listener at localhost/36263] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:03:51,597 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:03:51,635 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41683] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,752 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:03:51,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:03:51,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,760 INFO [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-13 00:03:51,760 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:51,761 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-13 00:03:51,761 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-13 00:03:51,761 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,761 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,763 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:51,763 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:51,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:51,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:51,763 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:51,763 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,763 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,765 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 00:03:51,765 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 00:03:51,765 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:51,765 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:51,766 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 00:03:51,766 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 00:03:51,766 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 00:03:51,766 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41321,1676246629301' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 00:03:51,766 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 00:03:51,767 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:51,767 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,767 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. started... 2023-02-13 00:03:51,767 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ca8b69f39aba0af281426b9b403ea10d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 00:03:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:51,783 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f1/de273deaf8244ccaa79c8cb6f323f38d 2023-02-13 00:03:51,809 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f2/ebe21b19b166494c81ed76d3d371208c 2023-02-13 00:03:51,814 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f1/de273deaf8244ccaa79c8cb6f323f38d as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/de273deaf8244ccaa79c8cb6f323f38d 2023-02-13 00:03:51,818 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/de273deaf8244ccaa79c8cb6f323f38d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:03:51,819 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/.tmp/f2/ebe21b19b166494c81ed76d3d371208c as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/ebe21b19b166494c81ed76d3d371208c 2023-02-13 00:03:51,825 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/ebe21b19b166494c81ed76d3d371208c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:03:51,825 INFO [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ca8b69f39aba0af281426b9b403ea10d in 58ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:51,826 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ca8b69f39aba0af281426b9b403ea10d: 2023-02-13 00:03:51,826 DEBUG [rs(jenkins-hbase4.apache.org,41683,1676246629273)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 00:03:51,826 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 00:03:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 00:03:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41683,1676246629273' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 00:03:51,829 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,829 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:51,830 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,830 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:51,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:51,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41683,1676246629273' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-13 00:03:51,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c0f3cd[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:51,832 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-13 00:03:51,832 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 00:03:51,833 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,833 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:51,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 00:03:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,41321,1676246629301' in zk 2023-02-13 00:03:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 00:03:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 00:03:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,41683,1676246629273' in zk 2023-02-13 00:03:51,834 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 00:03:51,834 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,834 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:51,834 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 00:03:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:51,835 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:51,835 DEBUG [member: 'jenkins-hbase4.apache.org,41321,1676246629301' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 00:03:51,835 DEBUG [member: 'jenkins-hbase4.apache.org,41683,1676246629273' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 00:03:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,41683,1676246629273': 2023-02-13 00:03:51,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41683,1676246629273' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-13 00:03:51,839 INFO [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-13 00:03:51,839 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:51,839 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:51,839 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,839 INFO [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:03:51,840 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,840 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,840 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,840 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,840 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:51,841 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,841 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,843 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:51,843 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:51,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:51,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:51,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-13 00:03:51,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:03:51,847 DEBUG [(jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:51,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:51,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:51,847 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:51,849 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,849 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:51,849 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,849 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,849 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:51,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:51,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:51,849 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:03:51,949 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:03:51,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:03:51,955 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676246631263 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:51,955 DEBUG [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46395/user/jenkins/test-data/1e4bdc81-8899-34d9-9c3d-0de979f8e976/foo/d00d0c42-349e-4c41-8c50-f2d97a5880f1/data/default/testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,956 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:51,956 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=ca8b69f39aba0af281426b9b403ea10d as ca8b69f39aba0af281426b9b403ea10d in snapshot foo 2023-02-13 00:03:51,957 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ca8b69f39aba0af281426b9b403ea10d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46395/user/jenkins/test-data/1e4bdc81-8899-34d9-9c3d-0de979f8e976/foo/d00d0c42-349e-4c41-8c50-f2d97a5880f1 2023-02-13 00:03:51,963 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:51,963 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac50a1f2cc42453581a939e1de608627 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,965 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e73a49d60a940fc8d26da516a6f234f from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,967 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ca8b69f39aba0af281426b9b403ea10d, disabling compactions & flushes 2023-02-13 00:03:51,967 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,967 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,967 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. after waiting 0 ms 2023-02-13 00:03:51,967 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,968 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:51,968 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ca8b69f39aba0af281426b9b403ea10d: Waiting for close lock at 1676246631967Disabling compacts and flushes for region at 1676246631967Disabling writes for close at 1676246631967Writing region close event to WAL at 1676246631968 (+1 ms)Closed at 1676246631968 2023-02-13 00:03:51,968 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676246631263 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:51,968 DEBUG [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46395/user/jenkins/test-data/1e4bdc81-8899-34d9-9c3d-0de979f8e976/foo/d00d0c42-349e-4c41-8c50-f2d97a5880f1 2023-02-13 00:03:51,968 DEBUG [Listener at localhost/36263] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46395/user/jenkins/test-data/1e4bdc81-8899-34d9-9c3d-0de979f8e976/foo/d00d0c42-349e-4c41-8c50-f2d97a5880f1 2023-02-13 00:03:51,968 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-data/ 2023-02-13 00:03:51,969 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----default/ 2023-02-13 00:03:51,969 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-13 00:03:51,970 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------ca8b69f39aba0af281426b9b403ea10d/ 2023-02-13 00:03:51,970 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:51,970 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:51,971 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=ca8b69f39aba0af281426b9b403ea10d-ac50a1f2cc42453581a939e1de608627 2023-02-13 00:03:51,971 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:51,971 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=ca8b69f39aba0af281426b9b403ea10d-9e73a49d60a940fc8d26da516a6f234f 2023-02-13 00:03:51,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 00:03:51,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 00:03:51,975 INFO [Listener at localhost/36263] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:51,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:03:51,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246631979"}]},"ts":"1676246631979"} 2023-02-13 00:03:51,980 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-13 00:03:51,982 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-13 00:03:51,983 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, UNASSIGN}] 2023-02-13 00:03:51,984 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, UNASSIGN 2023-02-13 00:03:51,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ca8b69f39aba0af281426b9b403ea10d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:51,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676246631985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246631985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246631985"}]},"ts":"1676246631985"} 2023-02-13 00:03:51,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ca8b69f39aba0af281426b9b403ea10d, server=jenkins-hbase4.apache.org,41683,1676246629273}] 2023-02-13 00:03:52,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:03:52,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:52,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ca8b69f39aba0af281426b9b403ea10d, disabling compactions & flushes 2023-02-13 00:03:52,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:52,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:52,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. after waiting 0 ms 2023-02-13 00:03:52,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:52,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:52,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d. 2023-02-13 00:03:52,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ca8b69f39aba0af281426b9b403ea10d: Waiting for close lock at 1676246632138Running coprocessor pre-close hooks at 1676246632138Disabling compacts and flushes for region at 1676246632138Disabling writes for close at 1676246632138Writing region close event to WAL at 1676246632139 (+1 ms)Running coprocessor post-close hooks at 1676246632143 (+4 ms)Closed at 1676246632144 (+1 ms) 2023-02-13 00:03:52,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:52,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ca8b69f39aba0af281426b9b403ea10d, regionState=CLOSED 2023-02-13 00:03:52,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676246632146"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246632146"}]},"ts":"1676246632146"} 2023-02-13 00:03:52,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 00:03:52,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ca8b69f39aba0af281426b9b403ea10d, server=jenkins-hbase4.apache.org,41683,1676246629273 in 161 msec 2023-02-13 00:03:52,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 00:03:52,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=ca8b69f39aba0af281426b9b403ea10d, UNASSIGN in 167 msec 2023-02-13 00:03:52,151 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246632151"}]},"ts":"1676246632151"} 2023-02-13 00:03:52,152 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-13 00:03:52,155 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-13 00:03:52,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 179 msec 2023-02-13 00:03:52,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:03:52,282 INFO [Listener at localhost/36263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-13 00:03:52,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,286 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,286 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:03:52,290 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:52,292 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1, FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2, FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/recovered.edits] 2023-02-13 00:03:52,296 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/ac50a1f2cc42453581a939e1de608627 to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/archive/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/ac50a1f2cc42453581a939e1de608627 2023-02-13 00:03:52,297 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/de273deaf8244ccaa79c8cb6f323f38d to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/archive/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f1/de273deaf8244ccaa79c8cb6f323f38d 2023-02-13 00:03:52,300 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/9e73a49d60a940fc8d26da516a6f234f to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/archive/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/9e73a49d60a940fc8d26da516a6f234f 2023-02-13 00:03:52,301 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/ebe21b19b166494c81ed76d3d371208c to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/archive/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/f2/ebe21b19b166494c81ed76d3d371208c 2023-02-13 00:03:52,304 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/recovered.edits/12.seqid to hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/archive/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d/recovered.edits/12.seqid 2023-02-13 00:03:52,304 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/.tmp/data/default/testInitTableSnapshotMapperJobConfig/ca8b69f39aba0af281426b9b403ea10d 2023-02-13 00:03:52,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 00:03:52,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,308 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-13 00:03:52,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-13 00:03:52,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-13 00:03:52,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246632311"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:52,312 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 00:03:52,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ca8b69f39aba0af281426b9b403ea10d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676246630444.ca8b69f39aba0af281426b9b403ea10d.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 00:03:52,312 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-13 00:03:52,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676246632312"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:52,316 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-13 00:03:52,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 00:03:52,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 35 msec 2023-02-13 00:03:52,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39135] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:03:52,388 INFO [Listener at localhost/36263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-13 00:03:52,388 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:03:52,388 INFO [Listener at localhost/36263] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:03:52,389 DEBUG [Listener at localhost/36263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e8d7147 to 127.0.0.1:64193 2023-02-13 00:03:52,389 DEBUG [Listener at localhost/36263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,389 DEBUG [Listener at localhost/36263] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:03:52,389 DEBUG [Listener at localhost/36263] util.JVMClusterUtil(257): Found active master hash=1051085148, stopped=false 2023-02-13 00:03:52,389 INFO [Listener at localhost/36263] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:52,393 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:52,393 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:52,393 INFO [Listener at localhost/36263] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:03:52,393 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:52,393 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:52,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:52,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:52,395 DEBUG [Listener at localhost/36263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bbe974f to 127.0.0.1:64193 2023-02-13 00:03:52,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:52,395 DEBUG [Listener at localhost/36263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,395 INFO [Listener at localhost/36263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41683,1676246629273' ***** 2023-02-13 00:03:52,395 INFO [Listener at localhost/36263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:52,396 INFO [Listener at localhost/36263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41321,1676246629301' ***** 2023-02-13 00:03:52,396 INFO [Listener at localhost/36263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:52,396 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:52,396 DEBUG [RS:1;jenkins-hbase4:41321] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a76658c to 127.0.0.1:64193 2023-02-13 00:03:52,396 DEBUG [RS:1;jenkins-hbase4:41321] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:52,396 INFO [RS:1;jenkins-hbase4:41321] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:52,396 INFO [RS:0;jenkins-hbase4:41683] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:52,397 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:03:52,397 INFO [RS:0;jenkins-hbase4:41683] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:52,397 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:52,397 INFO [RS:0;jenkins-hbase4:41683] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:52,397 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 00:03:52,398 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 00:03:52,399 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(3304): Received CLOSE for b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:52,399 DEBUG [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:03:52,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:52,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b5ac5554fbd2517c583c1383143fadc7, disabling compactions & flushes 2023-02-13 00:03:52,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:52,399 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:52,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:52,400 DEBUG [RS:0;jenkins-hbase4:41683] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x318ec7d2 to 127.0.0.1:64193 2023-02-13 00:03:52,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:52,400 DEBUG [RS:0;jenkins-hbase4:41683] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:52,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. after waiting 0 ms 2023-02-13 00:03:52,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:52,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:52,400 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 00:03:52,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing b5ac5554fbd2517c583c1383143fadc7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:03:52,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:52,400 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1479): Online Regions={b5ac5554fbd2517c583c1383143fadc7=hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7.} 2023-02-13 00:03:52,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-13 00:03:52,400 DEBUG [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1505): Waiting on b5ac5554fbd2517c583c1383143fadc7 2023-02-13 00:03:52,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/.tmp/info/f4f4997836044a3eac96cba6ceb84c38 2023-02-13 00:03:52,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/.tmp/info/89285f4ee2004ff0a77d2376cccd02a9 2023-02-13 00:03:52,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89285f4ee2004ff0a77d2376cccd02a9 2023-02-13 00:03:52,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/.tmp/info/f4f4997836044a3eac96cba6ceb84c38 as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/info/f4f4997836044a3eac96cba6ceb84c38 2023-02-13 00:03:52,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/info/f4f4997836044a3eac96cba6ceb84c38, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:03:52,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b5ac5554fbd2517c583c1383143fadc7 in 29ms, sequenceid=6, compaction requested=false 2023-02-13 00:03:52,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/.tmp/rep_barrier/5c648560699c426cb256e36cab04dd18 2023-02-13 00:03:52,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/namespace/b5ac5554fbd2517c583c1383143fadc7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:03:52,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:52,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b5ac5554fbd2517c583c1383143fadc7: Waiting for close lock at 1676246632399Running coprocessor pre-close hooks at 1676246632399Disabling compacts and flushes for region at 1676246632399Disabling writes for close at 1676246632400 (+1 ms)Obtaining lock to block concurrent updates at 1676246632400Preparing flush snapshotting stores in b5ac5554fbd2517c583c1383143fadc7 at 1676246632400Finished memstore snapshotting hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246632400Flushing stores of hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. at 1676246632401 (+1 ms)Flushing b5ac5554fbd2517c583c1383143fadc7/info: creating writer at 1676246632401Flushing b5ac5554fbd2517c583c1383143fadc7/info: appending metadata at 1676246632403 (+2 ms)Flushing b5ac5554fbd2517c583c1383143fadc7/info: closing flushed file at 1676246632403Flushing b5ac5554fbd2517c583c1383143fadc7/info: reopening flushed file at 1676246632424 (+21 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b5ac5554fbd2517c583c1383143fadc7 in 29ms, sequenceid=6, compaction requested=false at 1676246632429 (+5 ms)Writing region close event to WAL at 1676246632430 (+1 ms)Running coprocessor post-close hooks at 1676246632434 (+4 ms)Closed at 1676246632435 (+1 ms) 2023-02-13 00:03:52,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246629946.b5ac5554fbd2517c583c1383143fadc7. 2023-02-13 00:03:52,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c648560699c426cb256e36cab04dd18 2023-02-13 00:03:52,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/.tmp/table/d3e3cfec277044f8979cf6f7e392274c 2023-02-13 00:03:52,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3e3cfec277044f8979cf6f7e392274c 2023-02-13 00:03:52,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/.tmp/info/89285f4ee2004ff0a77d2376cccd02a9 as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/info/89285f4ee2004ff0a77d2376cccd02a9 2023-02-13 00:03:52,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89285f4ee2004ff0a77d2376cccd02a9 2023-02-13 00:03:52,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/info/89285f4ee2004ff0a77d2376cccd02a9, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 00:03:52,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/.tmp/rep_barrier/5c648560699c426cb256e36cab04dd18 as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/rep_barrier/5c648560699c426cb256e36cab04dd18 2023-02-13 00:03:52,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c648560699c426cb256e36cab04dd18 2023-02-13 00:03:52,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/rep_barrier/5c648560699c426cb256e36cab04dd18, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 00:03:52,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/.tmp/table/d3e3cfec277044f8979cf6f7e392274c as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/table/d3e3cfec277044f8979cf6f7e392274c 2023-02-13 00:03:52,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3e3cfec277044f8979cf6f7e392274c 2023-02-13 00:03:52,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/table/d3e3cfec277044f8979cf6f7e392274c, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 00:03:52,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=21, compaction requested=false 2023-02-13 00:03:52,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 00:03:52,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:03:52,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:52,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246632398Running coprocessor pre-close hooks at 1676246632398Disabling compacts and flushes for region at 1676246632398Disabling writes for close at 1676246632400 (+2 ms)Obtaining lock to block concurrent updates at 1676246632400Preparing flush snapshotting stores in 1588230740 at 1676246632400Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676246632400Flushing stores of hbase:meta,,1.1588230740 at 1676246632401 (+1 ms)Flushing 1588230740/info: creating writer at 1676246632401Flushing 1588230740/info: appending metadata at 1676246632404 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676246632404Flushing 1588230740/rep_barrier: creating writer at 1676246632423 (+19 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676246632425 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676246632425Flushing 1588230740/table: creating writer at 1676246632437 (+12 ms)Flushing 1588230740/table: appending metadata at 1676246632439 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676246632439Flushing 1588230740/info: reopening flushed file at 1676246632449 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676246632453 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676246632457 (+4 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=21, compaction requested=false at 1676246632461 (+4 ms)Writing region close event to WAL at 1676246632462 (+1 ms)Running coprocessor post-close hooks at 1676246632465 (+3 ms)Closed at 1676246632466 (+1 ms) 2023-02-13 00:03:52,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:52,490 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:52,492 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:52,599 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41321,1676246629301; all regions closed. 2023-02-13 00:03:52,601 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41683,1676246629273; all regions closed. 2023-02-13 00:03:52,610 DEBUG [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/oldWALs 2023-02-13 00:03:52,610 INFO [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41321%2C1676246629301.meta:.meta(num 1676246629887) 2023-02-13 00:03:52,613 DEBUG [RS:0;jenkins-hbase4:41683] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/oldWALs 2023-02-13 00:03:52,613 INFO [RS:0;jenkins-hbase4:41683] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41683%2C1676246629273:(num 1676246630300) 2023-02-13 00:03:52,613 DEBUG [RS:0;jenkins-hbase4:41683] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,613 INFO [RS:0;jenkins-hbase4:41683] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:52,613 INFO [RS:0;jenkins-hbase4:41683] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:52,613 INFO [RS:0;jenkins-hbase4:41683] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:52,613 INFO [RS:0;jenkins-hbase4:41683] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:52,613 INFO [RS:0;jenkins-hbase4:41683] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:52,613 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:52,614 INFO [RS:0;jenkins-hbase4:41683] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41683 2023-02-13 00:03:52,616 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:52,616 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:52,616 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41683,1676246629273 2023-02-13 00:03:52,616 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:52,616 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:52,616 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58045c90 rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,616 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41683,1676246629273] 2023-02-13 00:03:52,617 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41683,1676246629273; numProcessing=1 2023-02-13 00:03:52,618 DEBUG [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/oldWALs 2023-02-13 00:03:52,618 INFO [RS:1;jenkins-hbase4:41321] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41321%2C1676246629301:(num 1676246630617) 2023-02-13 00:03:52,618 DEBUG [RS:1;jenkins-hbase4:41321] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,618 INFO [RS:1;jenkins-hbase4:41321] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:52,618 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41683,1676246629273 already deleted, retry=false 2023-02-13 00:03:52,618 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41683,1676246629273 expired; onlineServers=1 2023-02-13 00:03:52,618 INFO [RS:1;jenkins-hbase4:41321] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:52,618 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:52,619 INFO [RS:1;jenkins-hbase4:41321] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41321 2023-02-13 00:03:52,622 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:52,622 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41321,1676246629301 2023-02-13 00:03:52,622 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41321,1676246629301] 2023-02-13 00:03:52,622 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41321,1676246629301; numProcessing=2 2023-02-13 00:03:52,623 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41321,1676246629301 already deleted, retry=false 2023-02-13 00:03:52,624 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41321,1676246629301 expired; onlineServers=0 2023-02-13 00:03:52,624 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39135,1676246629219' ***** 2023-02-13 00:03:52,624 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:03:52,624 DEBUG [M:0;jenkins-hbase4:39135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a99da50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:52,624 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39135,1676246629219 2023-02-13 00:03:52,624 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39135,1676246629219; all regions closed. 2023-02-13 00:03:52,624 DEBUG [M:0;jenkins-hbase4:39135] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:52,625 DEBUG [M:0;jenkins-hbase4:39135] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:03:52,625 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:03:52,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246629505] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246629505,5,FailOnTimeoutGroup] 2023-02-13 00:03:52,625 DEBUG [M:0;jenkins-hbase4:39135] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:03:52,625 INFO [M:0;jenkins-hbase4:39135] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:03:52,626 INFO [M:0;jenkins-hbase4:39135] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:03:52,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246629509] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246629509,5,FailOnTimeoutGroup] 2023-02-13 00:03:52,626 INFO [M:0;jenkins-hbase4:39135] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:03:52,626 DEBUG [M:0;jenkins-hbase4:39135] master.HMaster(1502): Stopping service threads 2023-02-13 00:03:52,627 INFO [M:0;jenkins-hbase4:39135] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:03:52,627 ERROR [M:0;jenkins-hbase4:39135] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 00:03:52,628 INFO [M:0;jenkins-hbase4:39135] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:03:52,628 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:03:52,723 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:52,723 INFO [RS:1;jenkins-hbase4:41321] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41321,1676246629301; zookeeper connection closed. 2023-02-13 00:03:52,723 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6841195e rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,724 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f2300c1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f2300c1 2023-02-13 00:03:52,724 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41321-0x1004afda5160002, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:52,724 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78f4c4af rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,726 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:52,726 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:52,726 INFO [M:0;jenkins-hbase4:39135] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:03:52,726 INFO [M:0;jenkins-hbase4:39135] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:03:52,727 DEBUG [M:0;jenkins-hbase4:39135] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:52,727 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:52,727 DEBUG [M:0;jenkins-hbase4:39135] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:52,727 DEBUG [M:0;jenkins-hbase4:39135] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:52,727 DEBUG [M:0;jenkins-hbase4:39135] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:52,727 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-13 00:03:52,727 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-13 00:03:52,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:52,727 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(332): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-13 00:03:52,739 INFO [M:0;jenkins-hbase4:39135] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/814a13e183644f14b0a247ba1a4cb739 2023-02-13 00:03:52,744 DEBUG [M:0;jenkins-hbase4:39135] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/814a13e183644f14b0a247ba1a4cb739 as hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/814a13e183644f14b0a247ba1a4cb739 2023-02-13 00:03:52,748 INFO [M:0;jenkins-hbase4:39135] regionserver.HStore(1080): Added hdfs://localhost:46395/user/jenkins/test-data/c970398a-12f1-3c03-6977-3d833c1741a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/814a13e183644f14b0a247ba1a4cb739, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 00:03:52,749 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false 2023-02-13 00:03:52,749 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:52,749 DEBUG [M:0;jenkins-hbase4:39135] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246632726Disabling compacts and flushes for region at 1676246632726Disabling writes for close at 1676246632727 (+1 ms)Obtaining lock to block concurrent updates at 1676246632727Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246632727Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57248, getHeapSize=68440, getOffHeapSize=0, getCellsCount=145 at 1676246632727Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246632728 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246632729 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246632731 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246632732 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246632745 (+13 ms)Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false at 1676246632749 (+4 ms)Writing region close event to WAL at 1676246632749Closed at 1676246632749 2023-02-13 00:03:52,753 INFO [M:0;jenkins-hbase4:39135] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:03:52,753 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:52,753 INFO [M:0;jenkins-hbase4:39135] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39135 2023-02-13 00:03:52,755 DEBUG [M:0;jenkins-hbase4:39135] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39135,1676246629219 already deleted, retry=false 2023-02-13 00:03:52,894 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:52,894 INFO [M:0;jenkins-hbase4:39135] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39135,1676246629219; zookeeper connection closed. 2023-02-13 00:03:52,894 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13be2252 rejected from java.util.concurrent.ThreadPoolExecutor@1781b4fd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,896 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:39135-0x1004afda5160000, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:52,896 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d50003 rejected from java.util.concurrent.ThreadPoolExecutor@1781b4fd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,994 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:52,994 INFO [RS:0;jenkins-hbase4:41683] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41683,1676246629273; zookeeper connection closed. 2023-02-13 00:03:52,994 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52f0afdc rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,995 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41683-0x1004afda5160001, quorum=127.0.0.1:64193, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:03:52,995 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@446aff45] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@446aff45 2023-02-13 00:03:52,995 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ac92e18 rejected from java.util.concurrent.ThreadPoolExecutor@5c3bc348[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:52,995 INFO [Listener at localhost/36263] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:03:52,995 WARN [Listener at localhost/36263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:03:52,999 INFO [Listener at localhost/36263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:53,105 WARN [BP-1471430567-172.31.14.131-1676246628632 heartbeating to localhost/127.0.0.1:46395] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:03:53,106 WARN [BP-1471430567-172.31.14.131-1676246628632 heartbeating to localhost/127.0.0.1:46395] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1471430567-172.31.14.131-1676246628632 (Datanode Uuid 1ca88f07-d2e7-4bb0-a2e2-07cc26b9735c) service to localhost/127.0.0.1:46395 2023-02-13 00:03:53,107 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/dfs/data/data3/current/BP-1471430567-172.31.14.131-1676246628632] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:53,107 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/dfs/data/data4/current/BP-1471430567-172.31.14.131-1676246628632] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:53,108 WARN [Listener at localhost/36263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:03:53,113 INFO [Listener at localhost/36263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:53,218 WARN [BP-1471430567-172.31.14.131-1676246628632 heartbeating to localhost/127.0.0.1:46395] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:03:53,218 WARN [BP-1471430567-172.31.14.131-1676246628632 heartbeating to localhost/127.0.0.1:46395] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1471430567-172.31.14.131-1676246628632 (Datanode Uuid 11e481bd-8ee0-4a65-b460-2fc1f02b70f4) service to localhost/127.0.0.1:46395 2023-02-13 00:03:53,218 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/dfs/data/data1/current/BP-1471430567-172.31.14.131-1676246628632] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:53,219 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/cluster_4703991e-10c5-4e63-0156-3c24e987dd2f/dfs/data/data2/current/BP-1471430567-172.31.14.131-1676246628632] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:03:53,229 INFO [Listener at localhost/36263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:03:53,343 INFO [Listener at localhost/36263] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:03:53,366 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:03:53,378 INFO [Listener at localhost/36263] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=177 (was 156) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36263 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39135,1676246629219)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:46395 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:46395 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:46395 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46395 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:46395 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:46395 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:46395 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 256), ProcessCount=168 (was 168), AvailableMemoryMB=3929 (was 3955) 2023-02-13 00:03:53,390 INFO [Listener at localhost/36263] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=177, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=3929 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/hadoop.log.dir so I do NOT create it in target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1 2023-02-13 00:03:53,400 WARN [Listener at localhost/36263] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/hadoop.tmp.dir so I do NOT create it in target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1 2023-02-13 00:03:53,400 WARN [Listener at localhost/36263] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/42632510-bc50-22cd-3b1d-0c3436782b35/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 00:03:53,400 DEBUG [Listener at localhost/36263] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555, deleteOnExit=true 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/test.cache.data in system properties and HBase conf 2023-02-13 00:03:53,400 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:03:53,401 DEBUG [Listener at localhost/36263] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:53,401 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:03:53,402 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:03:53,406 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:53,406 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:53,457 WARN [Listener at localhost/36263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:53,459 INFO [Listener at localhost/36263] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:53,463 INFO [Listener at localhost/36263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/java.io.tmpdir/Jetty_localhost_43759_hdfs____.g5tije/webapp 2023-02-13 00:03:53,555 INFO [Listener at localhost/36263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43759 2023-02-13 00:03:53,559 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:03:53,559 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:03:53,600 WARN [Listener at localhost/36127] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:53,615 WARN [Listener at localhost/36127] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:53,620 WARN [Listener at localhost/36127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:53,621 INFO [Listener at localhost/36127] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:53,628 INFO [Listener at localhost/36127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/java.io.tmpdir/Jetty_localhost_38825_datanode____ank6ot/webapp 2023-02-13 00:03:53,724 INFO [Listener at localhost/36127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38825 2023-02-13 00:03:53,732 WARN [Listener at localhost/45001] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:53,747 WARN [Listener at localhost/45001] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:03:53,750 WARN [Listener at localhost/45001] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:03:53,751 INFO [Listener at localhost/45001] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:03:53,754 INFO [Listener at localhost/45001] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/java.io.tmpdir/Jetty_localhost_38695_datanode____.qpf0wc/webapp 2023-02-13 00:03:53,916 INFO [Listener at localhost/45001] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38695 2023-02-13 00:03:53,925 WARN [Listener at localhost/42423] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:03:54,453 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe299ac64a847273: Processing first storage report for DS-96e14dd8-774e-49fd-a965-3af75dae4d01 from datanode fdbcb267-856f-411a-9674-e484e9ff4003 2023-02-13 00:03:54,453 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe299ac64a847273: from storage DS-96e14dd8-774e-49fd-a965-3af75dae4d01 node DatanodeRegistration(127.0.0.1:41433, datanodeUuid=fdbcb267-856f-411a-9674-e484e9ff4003, infoPort=43333, infoSecurePort=0, ipcPort=45001, storageInfo=lv=-57;cid=testClusterID;nsid=1118743651;c=1676246633409), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:54,453 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe299ac64a847273: Processing first storage report for DS-04f1af35-bb6c-44c2-831a-776fabd256bf from datanode fdbcb267-856f-411a-9674-e484e9ff4003 2023-02-13 00:03:54,453 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe299ac64a847273: from storage DS-04f1af35-bb6c-44c2-831a-776fabd256bf node DatanodeRegistration(127.0.0.1:41433, datanodeUuid=fdbcb267-856f-411a-9674-e484e9ff4003, infoPort=43333, infoSecurePort=0, ipcPort=45001, storageInfo=lv=-57;cid=testClusterID;nsid=1118743651;c=1676246633409), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:54,482 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd05a6f7a551c679: Processing first storage report for DS-035c2dff-c0e6-4364-868c-f79bcb416322 from datanode 9b94ff18-474e-460b-9717-e37ab6640e12 2023-02-13 00:03:54,482 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd05a6f7a551c679: from storage DS-035c2dff-c0e6-4364-868c-f79bcb416322 node DatanodeRegistration(127.0.0.1:34997, datanodeUuid=9b94ff18-474e-460b-9717-e37ab6640e12, infoPort=42291, infoSecurePort=0, ipcPort=42423, storageInfo=lv=-57;cid=testClusterID;nsid=1118743651;c=1676246633409), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:54,482 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdd05a6f7a551c679: Processing first storage report for DS-3b4ed30e-17d3-4fb0-87f4-004f55bc2cdd from datanode 9b94ff18-474e-460b-9717-e37ab6640e12 2023-02-13 00:03:54,482 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdd05a6f7a551c679: from storage DS-3b4ed30e-17d3-4fb0-87f4-004f55bc2cdd node DatanodeRegistration(127.0.0.1:34997, datanodeUuid=9b94ff18-474e-460b-9717-e37ab6640e12, infoPort=42291, infoSecurePort=0, ipcPort=42423, storageInfo=lv=-57;cid=testClusterID;nsid=1118743651;c=1676246633409), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:03:54,539 DEBUG [Listener at localhost/42423] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1 2023-02-13 00:03:54,542 INFO [Listener at localhost/42423] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/zookeeper_0, clientPort=63953, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:03:54,543 INFO [Listener at localhost/42423] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63953 2023-02-13 00:03:54,543 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,544 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,558 INFO [Listener at localhost/42423] util.FSUtils(479): Created version file at hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3 with version=8 2023-02-13 00:03:54,558 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,559 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,560 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/hbase-staging 2023-02-13 00:03:54,561 INFO [Listener at localhost/42423] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:54,561 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,562 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,562 INFO [Listener at localhost/42423] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:54,562 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,562 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:54,562 INFO [Listener at localhost/42423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:54,563 INFO [Listener at localhost/42423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46835 2023-02-13 00:03:54,563 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,564 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,564 INFO [Listener at localhost/42423] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46835 connecting to ZooKeeper ensemble=127.0.0.1:63953 2023-02-13 00:03:54,573 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:468350x0, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:54,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46835-0x1004afdb9f20000 connected 2023-02-13 00:03:54,593 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:54,594 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:54,594 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:54,596 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46835 2023-02-13 00:03:54,596 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46835 2023-02-13 00:03:54,596 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46835 2023-02-13 00:03:54,598 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46835 2023-02-13 00:03:54,598 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46835 2023-02-13 00:03:54,598 INFO [Listener at localhost/42423] master.HMaster(439): hbase.rootdir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3, hbase.cluster.distributed=false 2023-02-13 00:03:54,611 INFO [Listener at localhost/42423] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:54,611 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,611 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,612 INFO [Listener at localhost/42423] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:54,612 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,612 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:54,612 INFO [Listener at localhost/42423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:54,612 INFO [Listener at localhost/42423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42213 2023-02-13 00:03:54,613 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:54,614 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:54,614 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,615 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,616 INFO [Listener at localhost/42423] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42213 connecting to ZooKeeper ensemble=127.0.0.1:63953 2023-02-13 00:03:54,621 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:422130x0, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:54,622 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): regionserver:422130x0, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:54,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42213-0x1004afdb9f20001 connected 2023-02-13 00:03:54,623 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:54,623 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:54,628 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42213 2023-02-13 00:03:54,628 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42213 2023-02-13 00:03:54,628 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42213 2023-02-13 00:03:54,632 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42213 2023-02-13 00:03:54,632 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42213 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:03:54,644 INFO [Listener at localhost/42423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:03:54,645 INFO [Listener at localhost/42423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36715 2023-02-13 00:03:54,645 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:03:54,646 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:54,647 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,648 INFO [Listener at localhost/42423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,648 INFO [Listener at localhost/42423] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36715 connecting to ZooKeeper ensemble=127.0.0.1:63953 2023-02-13 00:03:54,652 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:367150x0, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:03:54,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36715-0x1004afdb9f20002 connected 2023-02-13 00:03:54,654 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:03:54,654 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:54,655 DEBUG [Listener at localhost/42423] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:03:54,656 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36715 2023-02-13 00:03:54,660 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36715 2023-02-13 00:03:54,660 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36715 2023-02-13 00:03:54,660 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36715 2023-02-13 00:03:54,661 DEBUG [Listener at localhost/42423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36715 2023-02-13 00:03:54,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,663 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:54,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,666 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:54,666 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:54,666 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:54,666 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:03:54,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:54,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46835,1676246634561 from backup master directory 2023-02-13 00:03:54,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:03:54,669 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,669 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:03:54,669 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:54,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/hbase.id with ID: c81e4a79-1aff-4627-a309-1b91fd9fca7e 2023-02-13 00:03:54,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:03:54,695 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:54,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x354e260b to 127.0.0.1:63953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:54,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d4d9374, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:54,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:54,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:03:54,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:54,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store-tmp 2023-02-13 00:03:54,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:54,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:03:54,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:54,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:54,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:03:54,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:54,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:03:54,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246634720Disabling compacts and flushes for region at 1676246634720Disabling writes for close at 1676246634721 (+1 ms)Writing region close event to WAL at 1676246634721Closed at 1676246634721 2023-02-13 00:03:54,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/WALs/jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46835%2C1676246634561, suffix=, logDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/WALs/jenkins-hbase4.apache.org,46835,1676246634561, archiveDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/oldWALs, maxLogs=10 2023-02-13 00:03:54,737 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK] 2023-02-13 00:03:54,739 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK] 2023-02-13 00:03:54,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/WALs/jenkins-hbase4.apache.org,46835,1676246634561/jenkins-hbase4.apache.org%2C46835%2C1676246634561.1676246634724 2023-02-13 00:03:54,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK], DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK]] 2023-02-13 00:03:54,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:54,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:54,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:54,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:54,743 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:54,745 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:03:54,745 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:03:54,746 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:54,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:54,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:54,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:03:54,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:54,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74624420, jitterRate=0.11199051141738892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:54,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246634742Initializing all the Stores at 1676246634743 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246634743Cleaning up temporary data from old regions at 1676246634747 (+4 ms)Cleaning up detritus from prior splits at 1676246634748 (+1 ms)Region opened successfully at 1676246634751 (+3 ms) 2023-02-13 00:03:54,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:03:54,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:03:54,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:03:54,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:03:54,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 00:03:54,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 00:03:54,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:03:54,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:03:54,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:03:54,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:03:54,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:03:54,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:03:54,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:03:54,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:03:54,770 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:54,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:03:54,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:03:54,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:03:54,773 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:54,773 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:54,773 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:54,773 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:54,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,46835,1676246634561, sessionid=0x1004afdb9f20000, setting cluster-up flag (Was=false) 2023-02-13 00:03:54,777 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:54,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:03:54,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,787 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:54,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:03:54,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:54,792 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.hbase-snapshot/.tmp 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:54,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246664799 2023-02-13 00:03:54,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:03:54,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:03:54,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:03:54,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:03:54,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:03:54,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:03:54,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,803 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:54,803 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:03:54,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:03:54,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:03:54,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:03:54,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:03:54,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:03:54,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246634804,5,FailOnTimeoutGroup] 2023-02-13 00:03:54,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246634805,5,FailOnTimeoutGroup] 2023-02-13 00:03:54,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:03:54,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,805 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:54,819 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:54,819 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:54,819 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3 2023-02-13 00:03:54,829 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:54,830 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:54,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/info 2023-02-13 00:03:54,831 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:54,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:54,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:54,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:54,833 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:54,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:54,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:54,834 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/table 2023-02-13 00:03:54,835 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:54,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:54,835 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740 2023-02-13 00:03:54,836 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740 2023-02-13 00:03:54,837 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:54,838 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:54,840 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:54,840 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73143751, jitterRate=0.0899268239736557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:54,840 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246634829Initializing all the Stores at 1676246634830 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246634830Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246634830Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246634830Cleaning up temporary data from old regions at 1676246634836 (+6 ms)Cleaning up detritus from prior splits at 1676246634837 (+1 ms)Region opened successfully at 1676246634840 (+3 ms) 2023-02-13 00:03:54,840 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:54,841 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:54,841 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:54,841 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:54,841 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:54,841 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:54,841 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246634840Disabling compacts and flushes for region at 1676246634840Disabling writes for close at 1676246634841 (+1 ms)Writing region close event to WAL at 1676246634841Closed at 1676246634841 2023-02-13 00:03:54,841 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:03:54,842 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:03:54,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:03:54,843 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:03:54,844 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:03:54,863 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(952): ClusterId : c81e4a79-1aff-4627-a309-1b91fd9fca7e 2023-02-13 00:03:54,863 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(952): ClusterId : c81e4a79-1aff-4627-a309-1b91fd9fca7e 2023-02-13 00:03:54,863 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:54,863 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:03:54,866 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:54,866 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:54,866 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:03:54,866 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:03:54,868 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:54,869 DEBUG [RS:1;jenkins-hbase4:36715] zookeeper.ReadOnlyZKClient(139): Connect 0x453f9310 to 127.0.0.1:63953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:54,869 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:03:54,870 DEBUG [RS:0;jenkins-hbase4:42213] zookeeper.ReadOnlyZKClient(139): Connect 0x162b7908 to 127.0.0.1:63953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:54,876 DEBUG [RS:1;jenkins-hbase4:36715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf865c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:54,876 DEBUG [RS:0;jenkins-hbase4:42213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18ec85bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:54,876 DEBUG [RS:1;jenkins-hbase4:36715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fc7f860, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:54,876 DEBUG [RS:0;jenkins-hbase4:42213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cd31278, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:03:54,885 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42213 2023-02-13 00:03:54,885 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36715 2023-02-13 00:03:54,885 INFO [RS:0;jenkins-hbase4:42213] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:54,885 INFO [RS:1;jenkins-hbase4:36715] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:03:54,885 INFO [RS:1;jenkins-hbase4:36715] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:54,885 INFO [RS:0;jenkins-hbase4:42213] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:03:54,885 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:54,885 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:03:54,885 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46835,1676246634561 with isa=jenkins-hbase4.apache.org/172.31.14.131:42213, startcode=1676246634611 2023-02-13 00:03:54,885 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46835,1676246634561 with isa=jenkins-hbase4.apache.org/172.31.14.131:36715, startcode=1676246634643 2023-02-13 00:03:54,885 DEBUG [RS:1;jenkins-hbase4:36715] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:54,885 DEBUG [RS:0;jenkins-hbase4:42213] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:03:54,888 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42033, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:54,888 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53581, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:03:54,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46835] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,889 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,890 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3 2023-02-13 00:03:54,890 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3 2023-02-13 00:03:54,890 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36127 2023-02-13 00:03:54,890 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:54,890 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36127 2023-02-13 00:03:54,890 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:03:54,893 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:54,893 DEBUG [RS:0;jenkins-hbase4:42213] zookeeper.ZKUtil(162): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,894 DEBUG [RS:1;jenkins-hbase4:36715] zookeeper.ZKUtil(162): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,894 WARN [RS:0;jenkins-hbase4:42213] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:54,894 WARN [RS:1;jenkins-hbase4:36715] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:03:54,894 INFO [RS:0;jenkins-hbase4:42213] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:54,894 INFO [RS:1;jenkins-hbase4:36715] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:54,894 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,894 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42213,1676246634611] 2023-02-13 00:03:54,894 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36715,1676246634643] 2023-02-13 00:03:54,894 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,898 DEBUG [RS:0;jenkins-hbase4:42213] zookeeper.ZKUtil(162): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,898 DEBUG [RS:1;jenkins-hbase4:36715] zookeeper.ZKUtil(162): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,899 DEBUG [RS:0;jenkins-hbase4:42213] zookeeper.ZKUtil(162): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,899 DEBUG [RS:1;jenkins-hbase4:36715] zookeeper.ZKUtil(162): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,899 DEBUG [RS:0;jenkins-hbase4:42213] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:54,899 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:03:54,900 INFO [RS:0;jenkins-hbase4:42213] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:54,900 INFO [RS:1;jenkins-hbase4:36715] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:03:54,901 INFO [RS:0;jenkins-hbase4:42213] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:54,901 INFO [RS:0;jenkins-hbase4:42213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:54,901 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,904 INFO [RS:1;jenkins-hbase4:36715] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:03:54,904 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:54,904 INFO [RS:1;jenkins-hbase4:36715] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:03:54,904 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,905 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:03:54,905 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:54,906 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,906 DEBUG [RS:0;jenkins-hbase4:42213] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,907 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:03:54,907 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,907 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,907 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,907 DEBUG [RS:1;jenkins-hbase4:36715] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:03:54,911 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,911 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,911 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,911 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,911 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,912 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,922 INFO [RS:0;jenkins-hbase4:42213] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:54,923 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42213,1676246634611-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,928 INFO [RS:1;jenkins-hbase4:36715] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:03:54,928 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36715,1676246634643-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:54,932 INFO [RS:0;jenkins-hbase4:42213] regionserver.Replication(203): jenkins-hbase4.apache.org,42213,1676246634611 started 2023-02-13 00:03:54,933 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42213,1676246634611, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42213, sessionid=0x1004afdb9f20001 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42213,1676246634611' 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42213,1676246634611' 2023-02-13 00:03:54,933 DEBUG [RS:0;jenkins-hbase4:42213] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:54,934 DEBUG [RS:0;jenkins-hbase4:42213] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:54,934 DEBUG [RS:0;jenkins-hbase4:42213] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:54,934 INFO [RS:0;jenkins-hbase4:42213] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:54,934 INFO [RS:0;jenkins-hbase4:42213] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:54,944 INFO [RS:1;jenkins-hbase4:36715] regionserver.Replication(203): jenkins-hbase4.apache.org,36715,1676246634643 started 2023-02-13 00:03:54,944 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36715,1676246634643, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36715, sessionid=0x1004afdb9f20002 2023-02-13 00:03:54,944 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:03:54,944 DEBUG [RS:1;jenkins-hbase4:36715] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,944 DEBUG [RS:1;jenkins-hbase4:36715] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36715,1676246634643' 2023-02-13 00:03:54,944 DEBUG [RS:1;jenkins-hbase4:36715] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:54,944 DEBUG [RS:1;jenkins-hbase4:36715] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36715,1676246634643' 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:54,945 DEBUG [RS:1;jenkins-hbase4:36715] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:03:54,945 INFO [RS:1;jenkins-hbase4:36715] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:03:54,945 INFO [RS:1;jenkins-hbase4:36715] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:03:54,994 DEBUG [jenkins-hbase4:46835] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:03:54,995 DEBUG [jenkins-hbase4:46835] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:54,996 DEBUG [jenkins-hbase4:46835] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:54,996 DEBUG [jenkins-hbase4:46835] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:54,996 DEBUG [jenkins-hbase4:46835] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:54,997 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36715,1676246634643, state=OPENING 2023-02-13 00:03:54,998 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:03:55,001 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:55,002 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:55,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:55,156 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:55,156 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:55,158 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:55,162 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:03:55,163 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:03:55,164 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36715%2C1676246634643.meta, suffix=.meta, logDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,36715,1676246634643, archiveDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/oldWALs, maxLogs=32 2023-02-13 00:03:55,182 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK] 2023-02-13 00:03:55,183 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK] 2023-02-13 00:03:55,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,36715,1676246634643/jenkins-hbase4.apache.org%2C36715%2C1676246634643.meta.1676246635164.meta 2023-02-13 00:03:55,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK], DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK]] 2023-02-13 00:03:55,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:55,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:03:55,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:03:55,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:03:55,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:03:55,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:03:55,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:03:55,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:03:55,188 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/info 2023-02-13 00:03:55,188 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/info 2023-02-13 00:03:55,188 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:03:55,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:55,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:03:55,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:55,190 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:03:55,190 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:03:55,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:55,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:03:55,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/table 2023-02-13 00:03:55,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/table 2023-02-13 00:03:55,191 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:03:55,192 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:55,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740 2023-02-13 00:03:55,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740 2023-02-13 00:03:55,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:03:55,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:03:55,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65964601, jitterRate=-0.0170508474111557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:03:55,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246635186Writing region info on filesystem at 1676246635186Initializing all the Stores at 1676246635187 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246635187Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246635187Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246635187Cleaning up temporary data from old regions at 1676246635194 (+7 ms)Cleaning up detritus from prior splits at 1676246635194Running coprocessor post-open hooks at 1676246635196 (+2 ms)Region opened successfully at 1676246635196 2023-02-13 00:03:55,197 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246635156 2023-02-13 00:03:55,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:03:55,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:03:55,202 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36715,1676246634643, state=OPEN 2023-02-13 00:03:55,204 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:03:55,204 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:03:55,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:03:55,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36715,1676246634643 in 202 msec 2023-02-13 00:03:55,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:03:55,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-02-13 00:03:55,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 415 msec 2023-02-13 00:03:55,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246634664, completionTime=-1 2023-02-13 00:03:55,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:03:55,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:03:55,212 DEBUG [hconnection-0x20be864b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:55,213 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:55,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:03:55,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246695214 2023-02-13 00:03:55,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246755214 2023-02-13 00:03:55,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-13 00:03:55,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46835,1676246634561-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:55,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46835,1676246634561-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:55,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46835,1676246634561-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:55,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46835, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:55,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:03:55,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:03:55,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:55,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:03:55,223 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:03:55,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:55,224 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:55,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,226 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599 empty. 2023-02-13 00:03:55,226 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,226 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:03:55,243 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:55,244 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7ffac005f49dd51f5e001405d7af1599, NAME => 'hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7ffac005f49dd51f5e001405d7af1599, disabling compactions & flushes 2023-02-13 00:03:55,253 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. after waiting 0 ms 2023-02-13 00:03:55,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,253 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,253 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7ffac005f49dd51f5e001405d7af1599: Waiting for close lock at 1676246635253Disabling compacts and flushes for region at 1676246635253Disabling writes for close at 1676246635253Writing region close event to WAL at 1676246635253Closed at 1676246635253 2023-02-13 00:03:55,256 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:55,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246635257"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246635257"}]},"ts":"1676246635257"} 2023-02-13 00:03:55,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:03:55,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:55,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246635261"}]},"ts":"1676246635261"} 2023-02-13 00:03:55,265 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:03:55,269 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:55,270 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:55,270 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:55,270 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:55,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7ffac005f49dd51f5e001405d7af1599, ASSIGN}] 2023-02-13 00:03:55,275 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7ffac005f49dd51f5e001405d7af1599, ASSIGN 2023-02-13 00:03:55,276 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7ffac005f49dd51f5e001405d7af1599, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36715,1676246634643; forceNewPlan=false, retain=false 2023-02-13 00:03:55,426 INFO [jenkins-hbase4:46835] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:03:55,427 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7ffac005f49dd51f5e001405d7af1599, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:55,427 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246635427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246635427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246635427"}]},"ts":"1676246635427"} 2023-02-13 00:03:55,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7ffac005f49dd51f5e001405d7af1599, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:55,585 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36715%2C1676246634643, suffix=, logDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,36715,1676246634643, archiveDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/oldWALs, maxLogs=32 2023-02-13 00:03:55,605 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK] 2023-02-13 00:03:55,605 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK] 2023-02-13 00:03:55,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,36715,1676246634643/jenkins-hbase4.apache.org%2C36715%2C1676246634643.1676246635587 2023-02-13 00:03:55,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK], DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK]] 2023-02-13 00:03:55,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7ffac005f49dd51f5e001405d7af1599, NAME => 'hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:03:55,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,608 INFO [StoreOpener-7ffac005f49dd51f5e001405d7af1599-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,609 DEBUG [StoreOpener-7ffac005f49dd51f5e001405d7af1599-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/info 2023-02-13 00:03:55,609 DEBUG [StoreOpener-7ffac005f49dd51f5e001405d7af1599-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/info 2023-02-13 00:03:55,610 INFO [StoreOpener-7ffac005f49dd51f5e001405d7af1599-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ffac005f49dd51f5e001405d7af1599 columnFamilyName info 2023-02-13 00:03:55,610 INFO [StoreOpener-7ffac005f49dd51f5e001405d7af1599-1] regionserver.HStore(310): Store=7ffac005f49dd51f5e001405d7af1599/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:55,611 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,611 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:55,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:55,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7ffac005f49dd51f5e001405d7af1599; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74575298, jitterRate=0.11125853657722473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:03:55,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7ffac005f49dd51f5e001405d7af1599: Running coprocessor pre-open hook at 1676246635607Writing region info on filesystem at 1676246635607Initializing all the Stores at 1676246635608 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246635608Cleaning up temporary data from old regions at 1676246635611 (+3 ms)Cleaning up detritus from prior splits at 1676246635611Running coprocessor post-open hooks at 1676246635616 (+5 ms)Region opened successfully at 1676246635616 2023-02-13 00:03:55,617 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599., pid=6, masterSystemTime=1676246635582 2023-02-13 00:03:55,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:55,620 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7ffac005f49dd51f5e001405d7af1599, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:55,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246635620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246635620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246635620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246635620"}]},"ts":"1676246635620"} 2023-02-13 00:03:55,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:03:55,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7ffac005f49dd51f5e001405d7af1599, server=jenkins-hbase4.apache.org,36715,1676246634643 in 192 msec 2023-02-13 00:03:55,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:03:55,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7ffac005f49dd51f5e001405d7af1599, ASSIGN in 352 msec 2023-02-13 00:03:55,625 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:55,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246635625"}]},"ts":"1676246635625"} 2023-02-13 00:03:55,626 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:03:55,628 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:55,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 407 msec 2023-02-13 00:03:55,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:03:55,724 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:55,724 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:55,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:03:55,735 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:55,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-13 00:03:55,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:03:55,756 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:03:55,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 00:03:55,766 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:03:55,768 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:03:55,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.099sec 2023-02-13 00:03:55,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:03:55,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:03:55,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:03:55,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46835,1676246634561-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:03:55,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46835,1676246634561-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:03:55,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:03:55,863 DEBUG [Listener at localhost/42423] zookeeper.ReadOnlyZKClient(139): Connect 0x36ee9869 to 127.0.0.1:63953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:55,868 DEBUG [Listener at localhost/42423] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9c99e19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:55,870 DEBUG [hconnection-0x6a383fd9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:55,872 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:55,873 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:55,873 DEBUG [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:03:55,874 DEBUG [Listener at localhost/42423] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:03:55,876 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:03:55,877 INFO [Listener at localhost/42423] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 00:03:55,877 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 00:03:55,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:03:55,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:33538 deadline: 1676246695877, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-13 00:03:55,878 INFO [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-13 00:03:55,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:03:55,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:55,884 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:03:55,884 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-13 00:03:55,884 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:03:55,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca empty. 2023-02-13 00:03:55,892 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c empty. 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 empty. 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 empty. 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 empty. 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f empty. 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:55,893 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f empty. 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 empty. 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 empty. 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce empty. 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:55,894 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:55,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 00:03:55,903 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 00:03:55,905 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => cb099a535604e954dbee3d51472c7e3f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,905 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4239165e1e5f4b674ce0f5fa428b16c9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,905 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1e2cf7d8a28d1116b669efc70841c3ca, NAME => 'testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing cb099a535604e954dbee3d51472c7e3f, disabling compactions & flushes 2023-02-13 00:03:55,916 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:55,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:55,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. after waiting 0 ms 2023-02-13 00:03:55,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:55,916 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:55,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for cb099a535604e954dbee3d51472c7e3f: Waiting for close lock at 1676246635916Disabling compacts and flushes for region at 1676246635916Disabling writes for close at 1676246635916Writing region close event to WAL at 1676246635916Closed at 1676246635916 2023-02-13 00:03:55,917 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1f8ca51c7a9e530bdc9d85b4dff39ca6, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 4239165e1e5f4b674ce0f5fa428b16c9, disabling compactions & flushes 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,921 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 1e2cf7d8a28d1116b669efc70841c3ca, disabling compactions & flushes 2023-02-13 00:03:55,921 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. after waiting 0 ms 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. after waiting 0 ms 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:55,921 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:55,921 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 4239165e1e5f4b674ce0f5fa428b16c9: Waiting for close lock at 1676246635921Disabling compacts and flushes for region at 1676246635921Disabling writes for close at 1676246635921Writing region close event to WAL at 1676246635921Closed at 1676246635921 2023-02-13 00:03:55,921 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 1e2cf7d8a28d1116b669efc70841c3ca: Waiting for close lock at 1676246635921Disabling compacts and flushes for region at 1676246635921Disabling writes for close at 1676246635921Writing region close event to WAL at 1676246635921Closed at 1676246635921 2023-02-13 00:03:55,922 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2a8bfee6458dd1e6cd4a0683b422316c, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,922 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => b4b8367f00edc3848dff018c6873d700, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,926 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,926 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 1f8ca51c7a9e530bdc9d85b4dff39ca6, disabling compactions & flushes 2023-02-13 00:03:55,926 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:55,926 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:55,926 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. after waiting 0 ms 2023-02-13 00:03:55,926 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:55,926 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:55,927 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: Waiting for close lock at 1676246635926Disabling compacts and flushes for region at 1676246635926Disabling writes for close at 1676246635926Writing region close event to WAL at 1676246635926Closed at 1676246635926 2023-02-13 00:03:55,927 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3ee031805692abffe8ee876aa480e4c0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,932 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,932 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,932 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing b4b8367f00edc3848dff018c6873d700, disabling compactions & flushes 2023-02-13 00:03:55,932 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 2a8bfee6458dd1e6cd4a0683b422316c, disabling compactions & flushes 2023-02-13 00:03:55,932 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:55,932 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:55,932 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:55,932 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. after waiting 0 ms 2023-02-13 00:03:55,933 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:55,933 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:55,933 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. after waiting 0 ms 2023-02-13 00:03:55,933 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:55,933 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:55,933 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for b4b8367f00edc3848dff018c6873d700: Waiting for close lock at 1676246635932Disabling compacts and flushes for region at 1676246635932Disabling writes for close at 1676246635933 (+1 ms)Writing region close event to WAL at 1676246635933Closed at 1676246635933 2023-02-13 00:03:55,933 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:55,933 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2a8bfee6458dd1e6cd4a0683b422316c: Waiting for close lock at 1676246635932Disabling compacts and flushes for region at 1676246635932Disabling writes for close at 1676246635933 (+1 ms)Writing region close event to WAL at 1676246635933Closed at 1676246635933 2023-02-13 00:03:55,933 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e6152666b53bd923a6be5a62b862c77f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,933 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b9cedd39285dfb3c89c03adecdb595ce, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,935 INFO [RS:0;jenkins-hbase4:42213] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42213%2C1676246634611, suffix=, logDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,42213,1676246634611, archiveDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/oldWALs, maxLogs=32 2023-02-13 00:03:55,950 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,950 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 3ee031805692abffe8ee876aa480e4c0, disabling compactions & flushes 2023-02-13 00:03:55,950 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:55,950 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:55,950 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. after waiting 0 ms 2023-02-13 00:03:55,950 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:55,950 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:55,950 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 3ee031805692abffe8ee876aa480e4c0: Waiting for close lock at 1676246635950Disabling compacts and flushes for region at 1676246635950Disabling writes for close at 1676246635950Writing region close event to WAL at 1676246635950Closed at 1676246635950 2023-02-13 00:03:55,951 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => eb1a798db4208e19623576a489e4fc10, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp 2023-02-13 00:03:55,961 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,961 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e6152666b53bd923a6be5a62b862c77f, disabling compactions & flushes 2023-02-13 00:03:55,962 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. after waiting 0 ms 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:55,962 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e6152666b53bd923a6be5a62b862c77f: Waiting for close lock at 1676246635961Disabling compacts and flushes for region at 1676246635961Disabling writes for close at 1676246635962 (+1 ms)Writing region close event to WAL at 1676246635962Closed at 1676246635962 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:55,962 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK] 2023-02-13 00:03:55,962 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK] 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b9cedd39285dfb3c89c03adecdb595ce, disabling compactions & flushes 2023-02-13 00:03:55,962 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. after waiting 0 ms 2023-02-13 00:03:55,962 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:55,962 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:55,963 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b9cedd39285dfb3c89c03adecdb595ce: Waiting for close lock at 1676246635962Disabling compacts and flushes for region at 1676246635962Disabling writes for close at 1676246635962Writing region close event to WAL at 1676246635962Closed at 1676246635962 2023-02-13 00:03:55,964 INFO [RS:0;jenkins-hbase4:42213] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/WALs/jenkins-hbase4.apache.org,42213,1676246634611/jenkins-hbase4.apache.org%2C42213%2C1676246634611.1676246635936 2023-02-13 00:03:55,968 DEBUG [RS:0;jenkins-hbase4:42213] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34997,DS-035c2dff-c0e6-4364-868c-f79bcb416322,DISK], DatanodeInfoWithStorage[127.0.0.1:41433,DS-96e14dd8-774e-49fd-a965-3af75dae4d01,DISK]] 2023-02-13 00:03:55,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:56,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:56,297 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 00:03:56,394 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing eb1a798db4208e19623576a489e4fc10, disabling compactions & flushes 2023-02-13 00:03:56,395 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. after waiting 0 ms 2023-02-13 00:03:56,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,395 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,395 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for eb1a798db4208e19623576a489e4fc10: Waiting for close lock at 1676246636395Disabling compacts and flushes for region at 1676246636395Disabling writes for close at 1676246636395Writing region close event to WAL at 1676246636395Closed at 1676246636395 2023-02-13 00:03:56,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246636399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246636399"}]},"ts":"1676246636399"} 2023-02-13 00:03:56,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 00:03:56,403 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:03:56,403 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246636403"}]},"ts":"1676246636403"} 2023-02-13 00:03:56,405 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-13 00:03:56,415 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:03:56,422 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:03:56,423 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:03:56,423 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:03:56,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, ASSIGN}] 2023-02-13 00:03:56,426 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, ASSIGN 2023-02-13 00:03:56,426 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, ASSIGN 2023-02-13 00:03:56,426 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, ASSIGN 2023-02-13 00:03:56,426 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, ASSIGN 2023-02-13 00:03:56,427 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, ASSIGN 2023-02-13 00:03:56,427 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36715,1676246634643; forceNewPlan=false, retain=false 2023-02-13 00:03:56,427 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42213,1676246634611; forceNewPlan=false, retain=false 2023-02-13 00:03:56,427 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42213,1676246634611; forceNewPlan=false, retain=false 2023-02-13 00:03:56,427 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36715,1676246634643; forceNewPlan=false, retain=false 2023-02-13 00:03:56,428 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42213,1676246634611; forceNewPlan=false, retain=false 2023-02-13 00:03:56,428 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, ASSIGN 2023-02-13 00:03:56,428 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, ASSIGN 2023-02-13 00:03:56,428 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, ASSIGN 2023-02-13 00:03:56,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, ASSIGN 2023-02-13 00:03:56,428 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, ASSIGN 2023-02-13 00:03:56,428 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42213,1676246634611; forceNewPlan=false, retain=false 2023-02-13 00:03:56,428 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36715,1676246634643; forceNewPlan=false, retain=false 2023-02-13 00:03:56,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36715,1676246634643; forceNewPlan=false, retain=false 2023-02-13 00:03:56,429 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42213,1676246634611; forceNewPlan=false, retain=false 2023-02-13 00:03:56,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36715,1676246634643; forceNewPlan=false, retain=false 2023-02-13 00:03:56,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:56,577 INFO [jenkins-hbase4:46835] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 00:03:56,583 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=eb1a798db4208e19623576a489e4fc10, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4239165e1e5f4b674ce0f5fa428b16c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2a8bfee6458dd1e6cd4a0683b422316c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e6152666b53bd923a6be5a62b862c77f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1f8ca51c7a9e530bdc9d85b4dff39ca6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636583"}]},"ts":"1676246636583"} 2023-02-13 00:03:56,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636583"}]},"ts":"1676246636583"} 2023-02-13 00:03:56,584 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636583"}]},"ts":"1676246636583"} 2023-02-13 00:03:56,584 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246636583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636583"}]},"ts":"1676246636583"} 2023-02-13 00:03:56,584 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636583"}]},"ts":"1676246636583"} 2023-02-13 00:03:56,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure e6152666b53bd923a6be5a62b862c77f, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:56,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 2a8bfee6458dd1e6cd4a0683b422316c, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:56,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 4239165e1e5f4b674ce0f5fa428b16c9, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:56,588 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure eb1a798db4208e19623576a489e4fc10, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:56,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 1f8ca51c7a9e530bdc9d85b4dff39ca6, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:56,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cb099a535604e954dbee3d51472c7e3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,590 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636589"}]},"ts":"1676246636589"} 2023-02-13 00:03:56,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure cb099a535604e954dbee3d51472c7e3f, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:56,594 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3ee031805692abffe8ee876aa480e4c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b9cedd39285dfb3c89c03adecdb595ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1e2cf7d8a28d1116b669efc70841c3ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b4b8367f00edc3848dff018c6873d700, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246636594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636594"}]},"ts":"1676246636594"} 2023-02-13 00:03:56,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636594"}]},"ts":"1676246636594"} 2023-02-13 00:03:56,594 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636594"}]},"ts":"1676246636594"} 2023-02-13 00:03:56,594 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246636594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246636594"}]},"ts":"1676246636594"} 2023-02-13 00:03:56,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 1e2cf7d8a28d1116b669efc70841c3ca, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:56,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure b9cedd39285dfb3c89c03adecdb595ce, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:56,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure 3ee031805692abffe8ee876aa480e4c0, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:56,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure b4b8367f00edc3848dff018c6873d700, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:56,738 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,739 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:03:56,740 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:03:56,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:56,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2a8bfee6458dd1e6cd4a0683b422316c, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 00:03:56,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:56,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9cedd39285dfb3c89c03adecdb595ce, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 00:03:56,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,746 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,746 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,747 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1 2023-02-13 00:03:56,747 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1 2023-02-13 00:03:56,747 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a8bfee6458dd1e6cd4a0683b422316c columnFamilyName f1 2023-02-13 00:03:56,748 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1 2023-02-13 00:03:56,748 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1 2023-02-13 00:03:56,748 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(310): Store=2a8bfee6458dd1e6cd4a0683b422316c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,748 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9cedd39285dfb3c89c03adecdb595ce columnFamilyName f1 2023-02-13 00:03:56,748 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,749 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(310): Store=b9cedd39285dfb3c89c03adecdb595ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,749 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,750 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2 2023-02-13 00:03:56,750 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2 2023-02-13 00:03:56,750 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2 2023-02-13 00:03:56,750 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2 2023-02-13 00:03:56,750 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a8bfee6458dd1e6cd4a0683b422316c columnFamilyName f2 2023-02-13 00:03:56,750 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9cedd39285dfb3c89c03adecdb595ce columnFamilyName f2 2023-02-13 00:03:56,750 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(310): Store=2a8bfee6458dd1e6cd4a0683b422316c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,751 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(310): Store=b9cedd39285dfb3c89c03adecdb595ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:56,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:56,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b9cedd39285dfb3c89c03adecdb595ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64930755, jitterRate=-0.032456353306770325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b9cedd39285dfb3c89c03adecdb595ce: Running coprocessor pre-open hook at 1676246636746Writing region info on filesystem at 1676246636746Initializing all the Stores at 1676246636746Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636746Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636746Cleaning up temporary data from old regions at 1676246636752 (+6 ms)Cleaning up detritus from prior splits at 1676246636753 (+1 ms)Running coprocessor post-open hooks at 1676246636763 (+10 ms)Region opened successfully at 1676246636763 2023-02-13 00:03:56,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2a8bfee6458dd1e6cd4a0683b422316c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68316437, jitterRate=0.017994239926338196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2a8bfee6458dd1e6cd4a0683b422316c: Running coprocessor pre-open hook at 1676246636745Writing region info on filesystem at 1676246636745Initializing all the Stores at 1676246636745Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636745Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636745Cleaning up temporary data from old regions at 1676246636752 (+7 ms)Cleaning up detritus from prior splits at 1676246636753 (+1 ms)Running coprocessor post-open hooks at 1676246636764 (+11 ms)Region opened successfully at 1676246636764 2023-02-13 00:03:56,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce., pid=28, masterSystemTime=1676246636742 2023-02-13 00:03:56,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c., pid=22, masterSystemTime=1676246636738 2023-02-13 00:03:56,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:56,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:56,767 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b9cedd39285dfb3c89c03adecdb595ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:56,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb099a535604e954dbee3d51472c7e3f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 00:03:56,768 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636767"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636767"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636767"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636767"}]},"ts":"1676246636767"} 2023-02-13 00:03:56,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:56,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1f8ca51c7a9e530bdc9d85b4dff39ca6, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 00:03:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2a8bfee6458dd1e6cd4a0683b422316c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636769"}]},"ts":"1676246636769"} 2023-02-13 00:03:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,770 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,771 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-13 00:03:56,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure b9cedd39285dfb3c89c03adecdb595ce, server=jenkins-hbase4.apache.org,36715,1676246634643 in 174 msec 2023-02-13 00:03:56,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-13 00:03:56,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 2a8bfee6458dd1e6cd4a0683b422316c, server=jenkins-hbase4.apache.org,42213,1676246634611 in 185 msec 2023-02-13 00:03:56,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, ASSIGN in 350 msec 2023-02-13 00:03:56,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, ASSIGN in 350 msec 2023-02-13 00:03:56,776 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1 2023-02-13 00:03:56,776 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1 2023-02-13 00:03:56,776 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f8ca51c7a9e530bdc9d85b4dff39ca6 columnFamilyName f1 2023-02-13 00:03:56,776 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1 2023-02-13 00:03:56,777 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1 2023-02-13 00:03:56,777 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb099a535604e954dbee3d51472c7e3f columnFamilyName f1 2023-02-13 00:03:56,777 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(310): Store=1f8ca51c7a9e530bdc9d85b4dff39ca6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,777 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,777 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(310): Store=cb099a535604e954dbee3d51472c7e3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,777 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,778 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2 2023-02-13 00:03:56,778 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2 2023-02-13 00:03:56,779 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f8ca51c7a9e530bdc9d85b4dff39ca6 columnFamilyName f2 2023-02-13 00:03:56,779 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2 2023-02-13 00:03:56,779 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2 2023-02-13 00:03:56,779 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(310): Store=1f8ca51c7a9e530bdc9d85b4dff39ca6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,779 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb099a535604e954dbee3d51472c7e3f columnFamilyName f2 2023-02-13 00:03:56,779 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(310): Store=cb099a535604e954dbee3d51472c7e3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:56,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:56,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1f8ca51c7a9e530bdc9d85b4dff39ca6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68535550, jitterRate=0.021259278059005737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: Running coprocessor pre-open hook at 1676246636770Writing region info on filesystem at 1676246636770Initializing all the Stores at 1676246636770Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636770Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636771 (+1 ms)Cleaning up temporary data from old regions at 1676246636781 (+10 ms)Cleaning up detritus from prior splits at 1676246636781Running coprocessor post-open hooks at 1676246636785 (+4 ms)Region opened successfully at 1676246636785 2023-02-13 00:03:56,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb099a535604e954dbee3d51472c7e3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75193139, jitterRate=0.12046508491039276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb099a535604e954dbee3d51472c7e3f: Running coprocessor pre-open hook at 1676246636769Writing region info on filesystem at 1676246636769Initializing all the Stores at 1676246636770 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636770Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636770Cleaning up temporary data from old regions at 1676246636781 (+11 ms)Cleaning up detritus from prior splits at 1676246636781Running coprocessor post-open hooks at 1676246636786 (+5 ms)Region opened successfully at 1676246636786 2023-02-13 00:03:56,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6., pid=25, masterSystemTime=1676246636738 2023-02-13 00:03:56,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f., pid=26, masterSystemTime=1676246636742 2023-02-13 00:03:56,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:56,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:56,788 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1f8ca51c7a9e530bdc9d85b4dff39ca6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,788 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636788"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636788"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636788"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636788"}]},"ts":"1676246636788"} 2023-02-13 00:03:56,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eb1a798db4208e19623576a489e4fc10, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 00:03:56,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:56,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:56,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:56,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,789 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cb099a535604e954dbee3d51472c7e3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,789 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636789"}]},"ts":"1676246636789"} 2023-02-13 00:03:56,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1e2cf7d8a28d1116b669efc70841c3ca, NAME => 'testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 00:03:56,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,791 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,791 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,792 DEBUG [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f1 2023-02-13 00:03:56,792 DEBUG [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f1 2023-02-13 00:03:56,792 DEBUG [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f1 2023-02-13 00:03:56,792 DEBUG [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f1 2023-02-13 00:03:56,792 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb1a798db4208e19623576a489e4fc10 columnFamilyName f1 2023-02-13 00:03:56,793 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e2cf7d8a28d1116b669efc70841c3ca columnFamilyName f1 2023-02-13 00:03:56,793 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(310): Store=eb1a798db4208e19623576a489e4fc10/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,793 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,793 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(310): Store=1e2cf7d8a28d1116b669efc70841c3ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,793 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-13 00:03:56,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 1f8ca51c7a9e530bdc9d85b4dff39ca6, server=jenkins-hbase4.apache.org,42213,1676246634611 in 202 msec 2023-02-13 00:03:56,794 DEBUG [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f2 2023-02-13 00:03:56,794 DEBUG [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f2 2023-02-13 00:03:56,794 DEBUG [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f2 2023-02-13 00:03:56,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-13 00:03:56,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure cb099a535604e954dbee3d51472c7e3f, server=jenkins-hbase4.apache.org,36715,1676246634643 in 200 msec 2023-02-13 00:03:56,795 DEBUG [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f2 2023-02-13 00:03:56,795 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb1a798db4208e19623576a489e4fc10 columnFamilyName f2 2023-02-13 00:03:56,795 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e2cf7d8a28d1116b669efc70841c3ca columnFamilyName f2 2023-02-13 00:03:56,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, ASSIGN in 370 msec 2023-02-13 00:03:56,795 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(310): Store=eb1a798db4208e19623576a489e4fc10/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,795 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(310): Store=1e2cf7d8a28d1116b669efc70841c3ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, ASSIGN in 371 msec 2023-02-13 00:03:56,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:56,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:56,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1e2cf7d8a28d1116b669efc70841c3ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62735251, jitterRate=-0.06517191231250763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1e2cf7d8a28d1116b669efc70841c3ca: Running coprocessor pre-open hook at 1676246636790Writing region info on filesystem at 1676246636790Initializing all the Stores at 1676246636791 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636791Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636791Cleaning up temporary data from old regions at 1676246636797 (+6 ms)Cleaning up detritus from prior splits at 1676246636798 (+1 ms)Running coprocessor post-open hooks at 1676246636801 (+3 ms)Region opened successfully at 1676246636802 (+1 ms) 2023-02-13 00:03:56,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca., pid=27, masterSystemTime=1676246636742 2023-02-13 00:03:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:56,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:56,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3ee031805692abffe8ee876aa480e4c0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 00:03:56,804 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1e2cf7d8a28d1116b669efc70841c3ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,804 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246636804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636804"}]},"ts":"1676246636804"} 2023-02-13 00:03:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eb1a798db4208e19623576a489e4fc10; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70837830, jitterRate=0.05556592345237732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eb1a798db4208e19623576a489e4fc10: Running coprocessor pre-open hook at 1676246636789Writing region info on filesystem at 1676246636789Initializing all the Stores at 1676246636790 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636790Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636790Cleaning up temporary data from old regions at 1676246636798 (+8 ms)Cleaning up detritus from prior splits at 1676246636798Running coprocessor post-open hooks at 1676246636805 (+7 ms)Region opened successfully at 1676246636805 2023-02-13 00:03:56,806 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10., pid=24, masterSystemTime=1676246636738 2023-02-13 00:03:56,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-13 00:03:56,807 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1 2023-02-13 00:03:56,807 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1 2023-02-13 00:03:56,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 1e2cf7d8a28d1116b669efc70841c3ca, server=jenkins-hbase4.apache.org,36715,1676246634643 in 210 msec 2023-02-13 00:03:56,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:56,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:56,808 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ee031805692abffe8ee876aa480e4c0 columnFamilyName f1 2023-02-13 00:03:56,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e6152666b53bd923a6be5a62b862c77f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 00:03:56,808 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=eb1a798db4208e19623576a489e4fc10, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,808 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(310): Store=3ee031805692abffe8ee876aa480e4c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,808 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246636808"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636808"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636808"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636808"}]},"ts":"1676246636808"} 2023-02-13 00:03:56,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, ASSIGN in 384 msec 2023-02-13 00:03:56,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,808 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,810 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,810 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2 2023-02-13 00:03:56,810 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2 2023-02-13 00:03:56,811 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ee031805692abffe8ee876aa480e4c0 columnFamilyName f2 2023-02-13 00:03:56,811 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1 2023-02-13 00:03:56,811 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1 2023-02-13 00:03:56,811 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(310): Store=3ee031805692abffe8ee876aa480e4c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-13 00:03:56,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure eb1a798db4208e19623576a489e4fc10, server=jenkins-hbase4.apache.org,42213,1676246634611 in 222 msec 2023-02-13 00:03:56,811 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6152666b53bd923a6be5a62b862c77f columnFamilyName f1 2023-02-13 00:03:56,812 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(310): Store=e6152666b53bd923a6be5a62b862c77f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,812 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,812 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, ASSIGN in 388 msec 2023-02-13 00:03:56,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,813 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2 2023-02-13 00:03:56,813 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2 2023-02-13 00:03:56,813 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6152666b53bd923a6be5a62b862c77f columnFamilyName f2 2023-02-13 00:03:56,814 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(310): Store=e6152666b53bd923a6be5a62b862c77f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:56,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3ee031805692abffe8ee876aa480e4c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61797695, jitterRate=-0.07914258539676666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3ee031805692abffe8ee876aa480e4c0: Running coprocessor pre-open hook at 1676246636804Writing region info on filesystem at 1676246636804Initializing all the Stores at 1676246636805 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636805Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636805Cleaning up temporary data from old regions at 1676246636813 (+8 ms)Cleaning up detritus from prior splits at 1676246636813Running coprocessor post-open hooks at 1676246636818 (+5 ms)Region opened successfully at 1676246636818 2023-02-13 00:03:56,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0., pid=29, masterSystemTime=1676246636742 2023-02-13 00:03:56,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:56,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:56,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:56,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:56,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b4b8367f00edc3848dff018c6873d700, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 00:03:56,820 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3ee031805692abffe8ee876aa480e4c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636820"}]},"ts":"1676246636820"} 2023-02-13 00:03:56,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,822 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-13 00:03:56,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure 3ee031805692abffe8ee876aa480e4c0, server=jenkins-hbase4.apache.org,36715,1676246634643 in 224 msec 2023-02-13 00:03:56,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,824 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1 2023-02-13 00:03:56,824 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1 2023-02-13 00:03:56,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, ASSIGN in 400 msec 2023-02-13 00:03:56,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e6152666b53bd923a6be5a62b862c77f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69629386, jitterRate=0.03755870461463928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,824 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4b8367f00edc3848dff018c6873d700 columnFamilyName f1 2023-02-13 00:03:56,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e6152666b53bd923a6be5a62b862c77f: Running coprocessor pre-open hook at 1676246636809Writing region info on filesystem at 1676246636809Initializing all the Stores at 1676246636809Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636809Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636810 (+1 ms)Cleaning up temporary data from old regions at 1676246636816 (+6 ms)Cleaning up detritus from prior splits at 1676246636816Running coprocessor post-open hooks at 1676246636824 (+8 ms)Region opened successfully at 1676246636824 2023-02-13 00:03:56,825 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(310): Store=b4b8367f00edc3848dff018c6873d700/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,825 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f., pid=21, masterSystemTime=1676246636738 2023-02-13 00:03:56,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:56,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:56,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:56,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4239165e1e5f4b674ce0f5fa428b16c9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 00:03:56,827 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e6152666b53bd923a6be5a62b862c77f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,827 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636827"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636827"}]},"ts":"1676246636827"} 2023-02-13 00:03:56,827 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2 2023-02-13 00:03:56,827 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2 2023-02-13 00:03:56,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:56,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,828 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4b8367f00edc3848dff018c6873d700 columnFamilyName f2 2023-02-13 00:03:56,828 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(310): Store=b4b8367f00edc3848dff018c6873d700/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-13 00:03:56,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure e6152666b53bd923a6be5a62b862c77f, server=jenkins-hbase4.apache.org,42213,1676246634611 in 243 msec 2023-02-13 00:03:56,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, ASSIGN in 407 msec 2023-02-13 00:03:56,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,832 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:56,833 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1 2023-02-13 00:03:56,833 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1 2023-02-13 00:03:56,833 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4239165e1e5f4b674ce0f5fa428b16c9 columnFamilyName f1 2023-02-13 00:03:56,834 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(310): Store=4239165e1e5f4b674ce0f5fa428b16c9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,834 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b4b8367f00edc3848dff018c6873d700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63139109, jitterRate=-0.0591539591550827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b4b8367f00edc3848dff018c6873d700: Running coprocessor pre-open hook at 1676246636821Writing region info on filesystem at 1676246636821Initializing all the Stores at 1676246636822 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636822Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636822Cleaning up temporary data from old regions at 1676246636830 (+8 ms)Cleaning up detritus from prior splits at 1676246636831 (+1 ms)Running coprocessor post-open hooks at 1676246636835 (+4 ms)Region opened successfully at 1676246636835 2023-02-13 00:03:56,835 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2 2023-02-13 00:03:56,835 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2 2023-02-13 00:03:56,835 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4239165e1e5f4b674ce0f5fa428b16c9 columnFamilyName f2 2023-02-13 00:03:56,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700., pid=30, masterSystemTime=1676246636742 2023-02-13 00:03:56,836 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(310): Store=4239165e1e5f4b674ce0f5fa428b16c9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:56,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:56,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:56,837 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b4b8367f00edc3848dff018c6873d700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:56,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636837"}]},"ts":"1676246636837"} 2023-02-13 00:03:56,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:56,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:56,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-13 00:03:56,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure b4b8367f00edc3848dff018c6873d700, server=jenkins-hbase4.apache.org,36715,1676246634643 in 241 msec 2023-02-13 00:03:56,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, ASSIGN in 416 msec 2023-02-13 00:03:56,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:03:56,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4239165e1e5f4b674ce0f5fa428b16c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60556816, jitterRate=-0.09763312339782715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:56,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4239165e1e5f4b674ce0f5fa428b16c9: Running coprocessor pre-open hook at 1676246636828Writing region info on filesystem at 1676246636828Initializing all the Stores at 1676246636829 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636829Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246636832 (+3 ms)Cleaning up temporary data from old regions at 1676246636837 (+5 ms)Cleaning up detritus from prior splits at 1676246636838 (+1 ms)Running coprocessor post-open hooks at 1676246636841 (+3 ms)Region opened successfully at 1676246636841 2023-02-13 00:03:56,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9., pid=23, masterSystemTime=1676246636738 2023-02-13 00:03:56,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:56,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:56,843 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4239165e1e5f4b674ce0f5fa428b16c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:56,843 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246636843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246636843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246636843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246636843"}]},"ts":"1676246636843"} 2023-02-13 00:03:56,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-13 00:03:56,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 4239165e1e5f4b674ce0f5fa428b16c9, server=jenkins-hbase4.apache.org,42213,1676246634611 in 257 msec 2023-02-13 00:03:56,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-13 00:03:56,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, ASSIGN in 422 msec 2023-02-13 00:03:56,847 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:03:56,847 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246636847"}]},"ts":"1676246636847"} 2023-02-13 00:03:56,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-13 00:03:56,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:03:56,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 969 msec 2023-02-13 00:03:56,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:03:56,991 INFO [Listener at localhost/42423] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-13 00:03:56,991 DEBUG [Listener at localhost/42423] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-13 00:03:56,991 INFO [Listener at localhost/42423] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:56,993 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-13 00:03:56,994 INFO [Listener at localhost/42423] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:03:56,994 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-13 00:03:56,994 INFO [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:03:57,026 DEBUG [hconnection-0x6a383fd9-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:57,037 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:57,040 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36715] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:57,043 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42213] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:57,106 INFO [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:03:57,106 INFO [Listener at localhost/42423] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:03:57,107 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 00:03:57,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246637107 (current time:1676246637107). 2023-02-13 00:03:57,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:03:57,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] zookeeper.ReadOnlyZKClient(139): Connect 0x0173bb62 to 127.0.0.1:63953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:03:57,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fb8c39d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:03:57,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:03:57,117 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47052, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:03:57,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0173bb62 to 127.0.0.1:63953 2023-02-13 00:03:57,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:57,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:03:57,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 00:03:57,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 00:03:57,122 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 00:03:57,123 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676247237123 2023-02-13 00:03:57,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 00:03:57,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,126 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 00:03:57,126 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:57,126 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:03:57,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 00:03:57,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-13 00:03:57,128 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 00:03:57,128 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676247237128 2023-02-13 00:03:57,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,144 INFO [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 00:03:57,144 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:57,145 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 00:03:57,145 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 00:03:57,222 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,222 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,223 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:57,223 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:57,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:57,223 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:57,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:57,224 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,224 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,224 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,225 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:57,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,225 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 00:03:57,225 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:57,225 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 00:03:57,228 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36715,1676246634643' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 00:03:57,228 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42213,1676246634611' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 00:03:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 00:03:57,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:57,229 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:03:57,229 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,229 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:57,230 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,230 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:57,230 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:57,230 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:57,231 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,231 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36715,1676246634643' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c7bd70[Count = 1] remaining members to acquire global barrier 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:57,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42213,1676246634611' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 00:03:57,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c7bd70[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:57,234 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 00:03:57,234 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,236 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,236 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,236 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,237 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:57,237 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,237 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:57,237 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. started... 2023-02-13 00:03:57,237 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:57,237 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. started... 2023-02-13 00:03:57,238 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 00:03:57,238 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:57,238 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:57,238 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:57,238 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:57,238 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b9cedd39285dfb3c89c03adecdb595ce 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 00:03:57,237 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 00:03:57,239 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:03:57,239 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. started... 2023-02-13 00:03:57,239 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. started... 2023-02-13 00:03:57,239 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. started... 2023-02-13 00:03:57,238 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cb099a535604e954dbee3d51472c7e3f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:57,238 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:57,238 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,240 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. started... 2023-02-13 00:03:57,240 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3ee031805692abffe8ee876aa480e4c0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:57,239 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1f8ca51c7a9e530bdc9d85b4dff39ca6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:57,239 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for eb1a798db4208e19623576a489e4fc10: 2023-02-13 00:03:57,241 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,241 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e6152666b53bd923a6be5a62b862c77f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:57,240 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:57,241 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,242 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:57,242 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:57,274 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. completed. 2023-02-13 00:03:57,274 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:57,274 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:57,274 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. started... 2023-02-13 00:03:57,274 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 00:03:57,278 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4239165e1e5f4b674ce0f5fa428b16c9 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 00:03:57,279 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f1/a695cf0cbe7345ca9265bd675f122820 2023-02-13 00:03:57,279 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f1/cace60c4a44348748e04e5745b84a280 2023-02-13 00:03:57,281 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f1/aac5d4067db2400c8c300b63ffb66262 2023-02-13 00:03:57,282 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f1/d5c089478a4c437b8cf192bb0ec48ad9 2023-02-13 00:03:57,284 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f1/344e66b0265e48a4969897e273a030f7 2023-02-13 00:03:57,328 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f1/8aeb940463924f5bb46e3cd2effdaaf3 2023-02-13 00:03:57,333 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f2/4eb063f1a7aa475d84840f3cdba64f2f 2023-02-13 00:03:57,344 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f1/d5c089478a4c437b8cf192bb0ec48ad9 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/d5c089478a4c437b8cf192bb0ec48ad9 2023-02-13 00:03:57,348 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/d5c089478a4c437b8cf192bb0ec48ad9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:57,349 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f2/4eb063f1a7aa475d84840f3cdba64f2f as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4eb063f1a7aa475d84840f3cdba64f2f 2023-02-13 00:03:57,357 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f2/e13e135e286a4fb5be06771a9394fa3c 2023-02-13 00:03:57,361 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f2/d19170757d6d4e47bf38deed86c07170 2023-02-13 00:03:57,361 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4eb063f1a7aa475d84840f3cdba64f2f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:57,362 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b9cedd39285dfb3c89c03adecdb595ce in 124ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,362 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-13 00:03:57,363 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b9cedd39285dfb3c89c03adecdb595ce: 2023-02-13 00:03:57,363 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,365 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,365 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/d5c089478a4c437b8cf192bb0ec48ad9] hfiles 2023-02-13 00:03:57,365 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/d5c089478a4c437b8cf192bb0ec48ad9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,365 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4eb063f1a7aa475d84840f3cdba64f2f] hfiles 2023-02-13 00:03:57,365 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f2/7161b66a997543aa83018c618bd889ed 2023-02-13 00:03:57,365 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4eb063f1a7aa475d84840f3cdba64f2f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,368 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f1/a695cf0cbe7345ca9265bd675f122820 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/a695cf0cbe7345ca9265bd675f122820 2023-02-13 00:03:57,370 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f1/aac5d4067db2400c8c300b63ffb66262 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/aac5d4067db2400c8c300b63ffb66262 2023-02-13 00:03:57,373 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/a695cf0cbe7345ca9265bd675f122820, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,374 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f2/e13e135e286a4fb5be06771a9394fa3c as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/e13e135e286a4fb5be06771a9394fa3c 2023-02-13 00:03:57,375 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/aac5d4067db2400c8c300b63ffb66262, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,376 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f2/d19170757d6d4e47bf38deed86c07170 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/d19170757d6d4e47bf38deed86c07170 2023-02-13 00:03:57,380 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f2/0e566a323f034b6da0d8158b7304842d 2023-02-13 00:03:57,381 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/e13e135e286a4fb5be06771a9394fa3c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,382 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cb099a535604e954dbee3d51472c7e3f in 144ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,383 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/d19170757d6d4e47bf38deed86c07170, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cb099a535604e954dbee3d51472c7e3f: 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/a695cf0cbe7345ca9265bd675f122820] hfiles 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/a695cf0cbe7345ca9265bd675f122820 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/e13e135e286a4fb5be06771a9394fa3c] hfiles 2023-02-13 00:03:57,385 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/e13e135e286a4fb5be06771a9394fa3c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,386 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3ee031805692abffe8ee876aa480e4c0 in 146ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3ee031805692abffe8ee876aa480e4c0: 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/aac5d4067db2400c8c300b63ffb66262] hfiles 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/aac5d4067db2400c8c300b63ffb66262 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/d19170757d6d4e47bf38deed86c07170] hfiles 2023-02-13 00:03:57,386 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/d19170757d6d4e47bf38deed86c07170 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,388 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f1/344e66b0265e48a4969897e273a030f7 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/344e66b0265e48a4969897e273a030f7 2023-02-13 00:03:57,390 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f1/cace60c4a44348748e04e5745b84a280 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/cace60c4a44348748e04e5745b84a280 2023-02-13 00:03:57,394 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/344e66b0265e48a4969897e273a030f7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,395 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/cace60c4a44348748e04e5745b84a280, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,395 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f2/0e566a323f034b6da0d8158b7304842d as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/0e566a323f034b6da0d8158b7304842d 2023-02-13 00:03:57,395 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f2/7161b66a997543aa83018c618bd889ed as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/7161b66a997543aa83018c618bd889ed 2023-02-13 00:03:57,400 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/0e566a323f034b6da0d8158b7304842d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,401 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1f8ca51c7a9e530bdc9d85b4dff39ca6 in 162ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,401 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: 2023-02-13 00:03:57,401 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,401 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,401 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/344e66b0265e48a4969897e273a030f7] hfiles 2023-02-13 00:03:57,401 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/344e66b0265e48a4969897e273a030f7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,402 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/0e566a323f034b6da0d8158b7304842d] hfiles 2023-02-13 00:03:57,402 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/0e566a323f034b6da0d8158b7304842d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,406 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/7161b66a997543aa83018c618bd889ed, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,406 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e6152666b53bd923a6be5a62b862c77f in 165ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e6152666b53bd923a6be5a62b862c77f: 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/cace60c4a44348748e04e5745b84a280] hfiles 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/cace60c4a44348748e04e5745b84a280 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/7161b66a997543aa83018c618bd889ed] hfiles 2023-02-13 00:03:57,407 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/7161b66a997543aa83018c618bd889ed for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,409 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. completed. 2023-02-13 00:03:57,409 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:57,409 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:57,409 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 00:03:57,409 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. started... 2023-02-13 00:03:57,421 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1e2cf7d8a28d1116b669efc70841c3ca: 2023-02-13 00:03:57,421 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,421 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,421 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:57,421 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 00:03:57,422 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f2/833d8343c00a4fabb239fb9ff61872d5 2023-02-13 00:03:57,428 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. completed. 2023-02-13 00:03:57,428 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:57,428 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:57,428 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 00:03:57,428 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. started... 2023-02-13 00:03:57,429 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:57,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 00:03:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:03:57,431 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 00:03:57,432 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. completed. 2023-02-13 00:03:57,432 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:57,432 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 00:03:57,433 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegion(2744): Flushing b4b8367f00edc3848dff018c6873d700 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:57,435 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. completed. 2023-02-13 00:03:57,435 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:57,435 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:57,435 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 00:03:57,435 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. started... 2023-02-13 00:03:57,435 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f1/8aeb940463924f5bb46e3cd2effdaaf3 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/8aeb940463924f5bb46e3cd2effdaaf3 2023-02-13 00:03:57,441 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2a8bfee6458dd1e6cd4a0683b422316c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 00:03:57,441 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/8aeb940463924f5bb46e3cd2effdaaf3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:57,441 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. completed. 2023-02-13 00:03:57,441 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:57,442 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 00:03:57,442 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f2/833d8343c00a4fabb239fb9ff61872d5 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/833d8343c00a4fabb239fb9ff61872d5 2023-02-13 00:03:57,448 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. completed. 2023-02-13 00:03:57,448 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:57,448 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 00:03:57,450 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/833d8343c00a4fabb239fb9ff61872d5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 00:03:57,451 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4239165e1e5f4b674ce0f5fa428b16c9 in 173ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,451 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4239165e1e5f4b674ce0f5fa428b16c9: 2023-02-13 00:03:57,451 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,451 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,454 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/8aeb940463924f5bb46e3cd2effdaaf3] hfiles 2023-02-13 00:03:57,454 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/8aeb940463924f5bb46e3cd2effdaaf3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,455 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/833d8343c00a4fabb239fb9ff61872d5] hfiles 2023-02-13 00:03:57,455 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/833d8343c00a4fabb239fb9ff61872d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,455 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f1/5d8f917a0a9a45eeacb1077d8cee775b 2023-02-13 00:03:57,464 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f1/5a105ec0cbd043a9af581f8fe88e7697 2023-02-13 00:03:57,468 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. completed. 2023-02-13 00:03:57,468 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 00:03:57,484 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f2/1588f637a4da4054a3c04a2e7cfe0cd7 2023-02-13 00:03:57,486 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f2/5945cd427c8b43969202771f442d48dd 2023-02-13 00:03:57,491 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f1/5d8f917a0a9a45eeacb1077d8cee775b as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/5d8f917a0a9a45eeacb1077d8cee775b 2023-02-13 00:03:57,492 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f1/5a105ec0cbd043a9af581f8fe88e7697 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5a105ec0cbd043a9af581f8fe88e7697 2023-02-13 00:03:57,496 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/5d8f917a0a9a45eeacb1077d8cee775b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,496 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5a105ec0cbd043a9af581f8fe88e7697, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,497 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f2/1588f637a4da4054a3c04a2e7cfe0cd7 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/1588f637a4da4054a3c04a2e7cfe0cd7 2023-02-13 00:03:57,497 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f2/5945cd427c8b43969202771f442d48dd as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/5945cd427c8b43969202771f442d48dd 2023-02-13 00:03:57,501 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/5945cd427c8b43969202771f442d48dd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,502 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2a8bfee6458dd1e6cd4a0683b422316c in 61ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2a8bfee6458dd1e6cd4a0683b422316c: 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5a105ec0cbd043a9af581f8fe88e7697] hfiles 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5a105ec0cbd043a9af581f8fe88e7697 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/5945cd427c8b43969202771f442d48dd] hfiles 2023-02-13 00:03:57,502 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/5945cd427c8b43969202771f442d48dd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,504 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/1588f637a4da4054a3c04a2e7cfe0cd7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 00:03:57,505 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b4b8367f00edc3848dff018c6873d700 in 72ms, sequenceid=5, compaction requested=false 2023-02-13 00:03:57,505 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b4b8367f00edc3848dff018c6873d700: 2023-02-13 00:03:57,505 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,505 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:03:57,506 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/5d8f917a0a9a45eeacb1077d8cee775b] hfiles 2023-02-13 00:03:57,506 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/5d8f917a0a9a45eeacb1077d8cee775b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,506 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/1588f637a4da4054a3c04a2e7cfe0cd7] hfiles 2023-02-13 00:03:57,506 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/1588f637a4da4054a3c04a2e7cfe0cd7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,512 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. completed. 2023-02-13 00:03:57,512 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 00:03:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 00:03:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 00:03:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42213,1676246634611' in zk 2023-02-13 00:03:57,514 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 00:03:57,514 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,514 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:57,514 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 00:03:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42213,1676246634611': 2023-02-13 00:03:57,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42213,1676246634611' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 00:03:57,522 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. completed. 2023-02-13 00:03:57,522 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:57,522 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 00:03:57,522 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 00:03:57,522 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,522 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 00:03:57,522 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36715,1676246634643' in zk 2023-02-13 00:03:57,524 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 00:03:57,524 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,524 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:57,524 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 00:03:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36715,1676246634643': 2023-02-13 00:03:57,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36715,1676246634643' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 00:03:57,527 INFO [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 00:03:57,527 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:57,527 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:57,527 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,527 INFO [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:03:57,529 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,529 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:03:57,530 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:57,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,530 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,532 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:57,532 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,539 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,539 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,539 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:57,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:57,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,540 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:57,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:57,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:03:57,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,540 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,541 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:03:57,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:03:57,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-13 00:03:57,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,607 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676246637124Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676246637540 (+416 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676246637540Writing data manifest for testWithMockedMapReduceMultiRegion at 1676246637552 (+12 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676246637569 (+17 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676246637606 (+37 ms) 2023-02-13 00:03:57,609 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 00:03:57,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 483 msec 2023-02-13 00:03:57,731 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:03:57,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 00:03:57,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:03:57,733 INFO [Listener at localhost/42423] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:03:57,737 INFO [Listener at localhost/42423] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:03:57,742 INFO [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:03:57,766 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36715] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:57,766 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42213] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:57,831 INFO [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:03:57,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:03:57,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,838 INFO [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 00:03:57,839 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:57,839 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 00:03:57,839 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 00:03:57,840 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,840 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,841 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:57,841 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:57,841 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:57,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:57,842 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:57,842 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,842 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:57,842 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:03:57,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 00:03:57,843 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 00:03:57,843 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 00:03:57,843 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:57,843 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:03:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 00:03:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 00:03:57,847 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:57,847 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. started... 2023-02-13 00:03:57,847 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:57,847 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. started... 2023-02-13 00:03:57,847 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1f8ca51c7a9e530bdc9d85b4dff39ca6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:57,847 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b9cedd39285dfb3c89c03adecdb595ce 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 00:03:57,848 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 00:03:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:57,848 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. started... 2023-02-13 00:03:57,848 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:57,848 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for eb1a798db4208e19623576a489e4fc10: 2023-02-13 00:03:57,848 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:57,848 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 00:03:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:03:57,849 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. started... 2023-02-13 00:03:57,849 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. started... 2023-02-13 00:03:57,849 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:57,849 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3ee031805692abffe8ee876aa480e4c0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:57,849 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb099a535604e954dbee3d51472c7e3f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:57,849 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. started... 2023-02-13 00:03:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 00:03:57,849 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e6152666b53bd923a6be5a62b862c77f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:57,849 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:57,849 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. started... 2023-02-13 00:03:57,850 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4239165e1e5f4b674ce0f5fa428b16c9 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 00:03:57,876 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f1/ff109230fbd34dd0b73ceff8ee1e5b3c 2023-02-13 00:03:57,880 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f1/304b0c6180de4fe08c67bd3e611cc123 2023-02-13 00:03:57,893 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f1/2453ef232e9c4014919e34c16592cfbe 2023-02-13 00:03:57,894 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f1/06fbb54f11ff42ce8b0f254195b853ee 2023-02-13 00:03:57,895 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f1/1a737f333a134a01986ca6a99cf77be3 2023-02-13 00:03:57,912 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f1/f96df1f78ce1463d852e8f50ecbdd06e 2023-02-13 00:03:57,932 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f2/750f289589a64e1da128bfd3fbbcc874 2023-02-13 00:03:57,933 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f2/68970772a4484d4c860d981d24ef9a5c 2023-02-13 00:03:57,940 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f2/6805628bfc364585b6e41d0bae1ee760 2023-02-13 00:03:57,941 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f1/304b0c6180de4fe08c67bd3e611cc123 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/304b0c6180de4fe08c67bd3e611cc123 2023-02-13 00:03:57,948 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f1/ff109230fbd34dd0b73ceff8ee1e5b3c as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/ff109230fbd34dd0b73ceff8ee1e5b3c 2023-02-13 00:03:57,949 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f2/4043bfa5060e4634a603d1f24fc04d54 2023-02-13 00:03:57,952 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f1/1a737f333a134a01986ca6a99cf77be3 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/1a737f333a134a01986ca6a99cf77be3 2023-02-13 00:03:57,952 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/304b0c6180de4fe08c67bd3e611cc123, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,953 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/.tmp/f2/68970772a4484d4c860d981d24ef9a5c as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/68970772a4484d4c860d981d24ef9a5c 2023-02-13 00:03:57,956 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/ff109230fbd34dd0b73ceff8ee1e5b3c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,957 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/.tmp/f2/750f289589a64e1da128bfd3fbbcc874 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/750f289589a64e1da128bfd3fbbcc874 2023-02-13 00:03:57,957 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f1/06fbb54f11ff42ce8b0f254195b853ee as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/06fbb54f11ff42ce8b0f254195b853ee 2023-02-13 00:03:57,958 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/1a737f333a134a01986ca6a99cf77be3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,959 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/68970772a4484d4c860d981d24ef9a5c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,959 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/.tmp/f2/6805628bfc364585b6e41d0bae1ee760 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/6805628bfc364585b6e41d0bae1ee760 2023-02-13 00:03:57,960 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3ee031805692abffe8ee876aa480e4c0 in 111ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:57,960 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3ee031805692abffe8ee876aa480e4c0: 2023-02-13 00:03:57,960 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:57,961 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:57,961 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. started... 2023-02-13 00:03:57,961 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1e2cf7d8a28d1116b669efc70841c3ca: 2023-02-13 00:03:57,961 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:57,961 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 00:03:57,961 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:57,961 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 00:03:57,961 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. started... 2023-02-13 00:03:57,961 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b4b8367f00edc3848dff018c6873d700 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:57,963 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/06fbb54f11ff42ce8b0f254195b853ee, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:57,963 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/.tmp/f2/4043bfa5060e4634a603d1f24fc04d54 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4043bfa5060e4634a603d1f24fc04d54 2023-02-13 00:03:57,965 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f2/706cab2fef8340b2b2a98bc0f89d0376 2023-02-13 00:03:57,967 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/750f289589a64e1da128bfd3fbbcc874, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,967 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1f8ca51c7a9e530bdc9d85b4dff39ca6 in 120ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:57,967 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: 2023-02-13 00:03:57,967 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:57,967 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:57,967 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 00:03:57,967 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. started... 2023-02-13 00:03:57,968 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2a8bfee6458dd1e6cd4a0683b422316c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 00:03:57,970 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f2/63cce4cdf7ee45b7bff7c41685309a75 2023-02-13 00:03:57,971 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/6805628bfc364585b6e41d0bae1ee760, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,973 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cb099a535604e954dbee3d51472c7e3f in 124ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:57,973 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb099a535604e954dbee3d51472c7e3f: 2023-02-13 00:03:57,973 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 00:03:57,976 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f1/f96df1f78ce1463d852e8f50ecbdd06e as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/f96df1f78ce1463d852e8f50ecbdd06e 2023-02-13 00:03:57,976 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4043bfa5060e4634a603d1f24fc04d54, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:57,977 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b9cedd39285dfb3c89c03adecdb595ce in 130ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:57,977 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b9cedd39285dfb3c89c03adecdb595ce: 2023-02-13 00:03:57,977 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:57,977 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 00:03:57,980 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/f96df1f78ce1463d852e8f50ecbdd06e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,984 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/.tmp/f2/706cab2fef8340b2b2a98bc0f89d0376 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/706cab2fef8340b2b2a98bc0f89d0376 2023-02-13 00:03:57,989 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f1/2453ef232e9c4014919e34c16592cfbe as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/2453ef232e9c4014919e34c16592cfbe 2023-02-13 00:03:57,990 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/706cab2fef8340b2b2a98bc0f89d0376, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:57,991 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e6152666b53bd923a6be5a62b862c77f in 142ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:57,991 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e6152666b53bd923a6be5a62b862c77f: 2023-02-13 00:03:57,991 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:57,991 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 00:03:58,001 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/2453ef232e9c4014919e34c16592cfbe, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:58,002 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/.tmp/f2/63cce4cdf7ee45b7bff7c41685309a75 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/63cce4cdf7ee45b7bff7c41685309a75 2023-02-13 00:03:58,003 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f1/85f04e0d0d7349ca909f9291e1cd3bc4 2023-02-13 00:03:58,008 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f1/5e659587a3f94b759dc9c128e32f1057 2023-02-13 00:03:58,010 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/63cce4cdf7ee45b7bff7c41685309a75, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 00:03:58,011 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4239165e1e5f4b674ce0f5fa428b16c9 in 161ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:58,011 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4239165e1e5f4b674ce0f5fa428b16c9: 2023-02-13 00:03:58,011 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,011 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 00:03:58,021 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f2/e345e8a9936048cc99cb82f11a7a5c38 2023-02-13 00:03:58,022 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f2/85852e3a5a5d4ce3b70262a250b3acdb 2023-02-13 00:03:58,030 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f1/5e659587a3f94b759dc9c128e32f1057 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5e659587a3f94b759dc9c128e32f1057 2023-02-13 00:03:58,030 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f1/85f04e0d0d7349ca909f9291e1cd3bc4 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/85f04e0d0d7349ca909f9291e1cd3bc4 2023-02-13 00:03:58,035 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/85f04e0d0d7349ca909f9291e1cd3bc4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:58,036 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5e659587a3f94b759dc9c128e32f1057, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:58,036 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/.tmp/f2/85852e3a5a5d4ce3b70262a250b3acdb as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/85852e3a5a5d4ce3b70262a250b3acdb 2023-02-13 00:03:58,037 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/.tmp/f2/e345e8a9936048cc99cb82f11a7a5c38 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/e345e8a9936048cc99cb82f11a7a5c38 2023-02-13 00:03:58,041 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/85852e3a5a5d4ce3b70262a250b3acdb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:58,042 INFO [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b4b8367f00edc3848dff018c6873d700 in 81ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:58,043 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b4b8367f00edc3848dff018c6873d700: 2023-02-13 00:03:58,043 DEBUG [rs(jenkins-hbase4.apache.org,36715,1676246634643)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,043 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 00:03:58,043 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 00:03:58,043 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,044 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 00:03:58,044 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36715,1676246634643' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 00:03:58,045 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/e345e8a9936048cc99cb82f11a7a5c38, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 00:03:58,046 INFO [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2a8bfee6458dd1e6cd4a0683b422316c in 78ms, sequenceid=9, compaction requested=false 2023-02-13 00:03:58,046 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2a8bfee6458dd1e6cd4a0683b422316c: 2023-02-13 00:03:58,046 DEBUG [rs(jenkins-hbase4.apache.org,42213,1676246634611)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:58,046 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 00:03:58,046 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 00:03:58,046 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,046 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 00:03:58,046 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42213,1676246634611' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 00:03:58,047 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,047 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:58,047 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,047 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:58,053 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:58,053 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,054 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,054 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:03:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:58,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36715,1676246634643' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22f82d70[Count = 1] remaining members to acquire global barrier 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:58,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42213,1676246634611' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 00:03:58,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22f82d70[Count = 0] remaining members to acquire global barrier 2023-02-13 00:03:58,058 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 00:03:58,058 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,059 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:58,059 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 00:03:58,059 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 00:03:58,059 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,059 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 00:03:58,059 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42213,1676246634611' in zk 2023-02-13 00:03:58,060 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36715,1676246634643' in zk 2023-02-13 00:03:58,060 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,060 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:03:58,062 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,062 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 00:03:58,062 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:58,062 DEBUG [member: 'jenkins-hbase4.apache.org,36715,1676246634643' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 00:03:58,063 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:58,063 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 00:03:58,063 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:58,063 DEBUG [member: 'jenkins-hbase4.apache.org,42213,1676246634611' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 00:03:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36715,1676246634643': 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36715,1676246634643' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:58,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42213,1676246634611': 2023-02-13 00:03:58,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42213,1676246634611' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 00:03:58,069 INFO [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 00:03:58,069 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:03:58,069 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:03:58,069 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,069 INFO [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:03:58,071 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,071 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,071 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:58,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,071 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,071 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:03:58,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:58,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:58,072 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,073 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:03:58,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,074 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:03:58,075 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:58,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:58,079 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-13 00:03:58,079 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:03:58,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:03:58,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,079 DEBUG [(jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:58,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:58,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:03:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:58,080 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,079 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:03:58,080 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:03:58,180 DEBUG [Listener at localhost/42423] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:03:58,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:03:58,186 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676246637107 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:58,187 DEBUG [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,187 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:58,187 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:58,187 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:58,187 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(239): region to add: 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=b9cedd39285dfb3c89c03adecdb595ce as b9cedd39285dfb3c89c03adecdb595ce in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=1f8ca51c7a9e530bdc9d85b4dff39ca6 as 1f8ca51c7a9e530bdc9d85b4dff39ca6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=eb1a798db4208e19623576a489e4fc10 as eb1a798db4208e19623576a489e4fc10 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=e6152666b53bd923a6be5a62b862c77f as e6152666b53bd923a6be5a62b862c77f in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=cb099a535604e954dbee3d51472c7e3f as cb099a535604e954dbee3d51472c7e3f in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=3ee031805692abffe8ee876aa480e4c0 as 3ee031805692abffe8ee876aa480e4c0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,188 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=1e2cf7d8a28d1116b669efc70841c3ca as 1e2cf7d8a28d1116b669efc70841c3ca in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,189 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=4239165e1e5f4b674ce0f5fa428b16c9 as 4239165e1e5f4b674ce0f5fa428b16c9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,189 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=b4b8367f00edc3848dff018c6873d700 as b4b8367f00edc3848dff018c6873d700 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,189 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(585): clone region=2a8bfee6458dd1e6cd4a0683b422316c as 2a8bfee6458dd1e6cd4a0683b422316c in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,190 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 4239165e1e5f4b674ce0f5fa428b16c9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,190 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b9cedd39285dfb3c89c03adecdb595ce, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,190 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 1e2cf7d8a28d1116b669efc70841c3ca, NAME => 'testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,191 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => cb099a535604e954dbee3d51472c7e3f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,191 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e6152666b53bd923a6be5a62b862c77f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,191 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => eb1a798db4208e19623576a489e4fc10, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,191 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1f8ca51c7a9e530bdc9d85b4dff39ca6, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,192 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3ee031805692abffe8ee876aa480e4c0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,220 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,221 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,221 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cace60c4a44348748e04e5745b84a280 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,221 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aac5d4067db2400c8c300b63ffb66262 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,228 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,228 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 344e66b0265e48a4969897e273a030f7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,231 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7161b66a997543aa83018c618bd889ed from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,232 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d19170757d6d4e47bf38deed86c07170 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 1e2cf7d8a28d1116b669efc70841c3ca, disabling compactions & flushes 2023-02-13 00:03:58,232 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. after waiting 0 ms 2023-02-13 00:03:58,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,232 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 1e2cf7d8a28d1116b669efc70841c3ca: Waiting for close lock at 1676246638232Disabling compacts and flushes for region at 1676246638232Disabling writes for close at 1676246638232Writing region close event to WAL at 1676246638232Closed at 1676246638232 2023-02-13 00:03:58,232 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0e566a323f034b6da0d8158b7304842d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,233 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => b4b8367f00edc3848dff018c6873d700, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,239 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,239 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8aeb940463924f5bb46e3cd2effdaaf3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,240 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a695cf0cbe7345ca9265bd675f122820 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,241 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e6152666b53bd923a6be5a62b862c77f, disabling compactions & flushes 2023-02-13 00:03:58,241 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:58,241 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:58,241 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. after waiting 0 ms 2023-02-13 00:03:58,241 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:58,241 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:58,241 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e6152666b53bd923a6be5a62b862c77f: Waiting for close lock at 1676246638241Disabling compacts and flushes for region at 1676246638241Disabling writes for close at 1676246638241Writing region close event to WAL at 1676246638241Closed at 1676246638241 2023-02-13 00:03:58,242 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 2a8bfee6458dd1e6cd4a0683b422316c, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3ee031805692abffe8ee876aa480e4c0, disabling compactions & flushes 2023-02-13 00:03:58,248 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:58,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:58,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. after waiting 0 ms 2023-02-13 00:03:58,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:58,248 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:58,248 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3ee031805692abffe8ee876aa480e4c0: Waiting for close lock at 1676246638248Disabling compacts and flushes for region at 1676246638248Disabling writes for close at 1676246638248Writing region close event to WAL at 1676246638248Closed at 1676246638248 2023-02-13 00:03:58,255 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 1f8ca51c7a9e530bdc9d85b4dff39ca6, disabling compactions & flushes 2023-02-13 00:03:58,255 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,255 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,255 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,255 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. after waiting 0 ms 2023-02-13 00:03:58,255 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing eb1a798db4208e19623576a489e4fc10, disabling compactions & flushes 2023-02-13 00:03:58,255 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,256 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,256 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: Waiting for close lock at 1676246638255Disabling compacts and flushes for region at 1676246638255Disabling writes for close at 1676246638255Writing region close event to WAL at 1676246638256 (+1 ms)Closed at 1676246638256 2023-02-13 00:03:58,256 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,256 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:58,256 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:58,256 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. after waiting 0 ms 2023-02-13 00:03:58,256 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d5c089478a4c437b8cf192bb0ec48ad9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,256 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:58,256 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:58,256 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for eb1a798db4208e19623576a489e4fc10: Waiting for close lock at 1676246638255Disabling compacts and flushes for region at 1676246638255Disabling writes for close at 1676246638256 (+1 ms)Writing region close event to WAL at 1676246638256Closed at 1676246638256 2023-02-13 00:03:58,257 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 833d8343c00a4fabb239fb9ff61872d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,257 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e13e135e286a4fb5be06771a9394fa3c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,259 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4eb063f1a7aa475d84840f3cdba64f2f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,259 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing cb099a535604e954dbee3d51472c7e3f, disabling compactions & flushes 2023-02-13 00:03:58,259 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,259 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,259 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. after waiting 0 ms 2023-02-13 00:03:58,259 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,260 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,260 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for cb099a535604e954dbee3d51472c7e3f: Waiting for close lock at 1676246638259Disabling compacts and flushes for region at 1676246638259Disabling writes for close at 1676246638259Writing region close event to WAL at 1676246638259Closed at 1676246638260 (+1 ms) 2023-02-13 00:03:58,260 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 4239165e1e5f4b674ce0f5fa428b16c9, disabling compactions & flushes 2023-02-13 00:03:58,260 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,260 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,260 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. after waiting 0 ms 2023-02-13 00:03:58,260 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,260 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,260 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 4239165e1e5f4b674ce0f5fa428b16c9: Waiting for close lock at 1676246638260Disabling compacts and flushes for region at 1676246638260Disabling writes for close at 1676246638260Writing region close event to WAL at 1676246638260Closed at 1676246638260 2023-02-13 00:03:58,261 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,261 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d8f917a0a9a45eeacb1077d8cee775b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,262 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b9cedd39285dfb3c89c03adecdb595ce, disabling compactions & flushes 2023-02-13 00:03:58,262 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,262 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,262 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. after waiting 0 ms 2023-02-13 00:03:58,262 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,262 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,262 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b9cedd39285dfb3c89c03adecdb595ce: Waiting for close lock at 1676246638261Disabling compacts and flushes for region at 1676246638261Disabling writes for close at 1676246638262 (+1 ms)Writing region close event to WAL at 1676246638262Closed at 1676246638262 2023-02-13 00:03:58,262 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,262 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a105ec0cbd043a9af581f8fe88e7697 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,263 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1588f637a4da4054a3c04a2e7cfe0cd7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,264 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5945cd427c8b43969202771f442d48dd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:58,265 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing b4b8367f00edc3848dff018c6873d700, disabling compactions & flushes 2023-02-13 00:03:58,265 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. after waiting 0 ms 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,266 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for b4b8367f00edc3848dff018c6873d700: Waiting for close lock at 1676246638265Disabling compacts and flushes for region at 1676246638265Disabling writes for close at 1676246638266 (+1 ms)Writing region close event to WAL at 1676246638266Closed at 1676246638266 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 2a8bfee6458dd1e6cd4a0683b422316c, disabling compactions & flushes 2023-02-13 00:03:58,266 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. after waiting 0 ms 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:58,266 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:58,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 2a8bfee6458dd1e6cd4a0683b422316c: Waiting for close lock at 1676246638266Disabling compacts and flushes for region at 1676246638266Disabling writes for close at 1676246638266Writing region close event to WAL at 1676246638266Closed at 1676246638266 2023-02-13 00:03:58,267 INFO [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676246637107 type: FLUSH version: 2 ttl: 0 2023-02-13 00:03:58,267 DEBUG [Listener at localhost/42423] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,267 DEBUG [Listener at localhost/42423] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58 2023-02-13 00:03:58,267 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-data/ 2023-02-13 00:03:58,268 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----default/ 2023-02-13 00:03:58,268 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-13 00:03:58,269 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------1e2cf7d8a28d1116b669efc70841c3ca/ 2023-02-13 00:03:58,269 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,269 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------1f8ca51c7a9e530bdc9d85b4dff39ca6/ 2023-02-13 00:03:58,269 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,269 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,270 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1f8ca51c7a9e530bdc9d85b4dff39ca6-344e66b0265e48a4969897e273a030f7 2023-02-13 00:03:58,270 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,270 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1f8ca51c7a9e530bdc9d85b4dff39ca6-0e566a323f034b6da0d8158b7304842d 2023-02-13 00:03:58,270 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------2a8bfee6458dd1e6cd4a0683b422316c/ 2023-02-13 00:03:58,270 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,270 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,271 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2a8bfee6458dd1e6cd4a0683b422316c-5a105ec0cbd043a9af581f8fe88e7697 2023-02-13 00:03:58,271 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,271 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2a8bfee6458dd1e6cd4a0683b422316c-5945cd427c8b43969202771f442d48dd 2023-02-13 00:03:58,271 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------3ee031805692abffe8ee876aa480e4c0/ 2023-02-13 00:03:58,271 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,271 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3ee031805692abffe8ee876aa480e4c0-aac5d4067db2400c8c300b63ffb66262 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3ee031805692abffe8ee876aa480e4c0-d19170757d6d4e47bf38deed86c07170 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------4239165e1e5f4b674ce0f5fa428b16c9/ 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,272 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4239165e1e5f4b674ce0f5fa428b16c9-8aeb940463924f5bb46e3cd2effdaaf3 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4239165e1e5f4b674ce0f5fa428b16c9-833d8343c00a4fabb239fb9ff61872d5 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------b4b8367f00edc3848dff018c6873d700/ 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b4b8367f00edc3848dff018c6873d700-5d8f917a0a9a45eeacb1077d8cee775b 2023-02-13 00:03:58,273 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,274 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b4b8367f00edc3848dff018c6873d700-1588f637a4da4054a3c04a2e7cfe0cd7 2023-02-13 00:03:58,274 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------b9cedd39285dfb3c89c03adecdb595ce/ 2023-02-13 00:03:58,274 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,274 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,274 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b9cedd39285dfb3c89c03adecdb595ce-d5c089478a4c437b8cf192bb0ec48ad9 2023-02-13 00:03:58,274 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,275 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b9cedd39285dfb3c89c03adecdb595ce-4eb063f1a7aa475d84840f3cdba64f2f 2023-02-13 00:03:58,275 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------cb099a535604e954dbee3d51472c7e3f/ 2023-02-13 00:03:58,275 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,275 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,275 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cb099a535604e954dbee3d51472c7e3f-a695cf0cbe7345ca9265bd675f122820 2023-02-13 00:03:58,275 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,276 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cb099a535604e954dbee3d51472c7e3f-e13e135e286a4fb5be06771a9394fa3c 2023-02-13 00:03:58,276 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------e6152666b53bd923a6be5a62b862c77f/ 2023-02-13 00:03:58,276 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,276 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:03:58,276 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e6152666b53bd923a6be5a62b862c77f-cace60c4a44348748e04e5745b84a280 2023-02-13 00:03:58,276 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:03:58,277 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e6152666b53bd923a6be5a62b862c77f-7161b66a997543aa83018c618bd889ed 2023-02-13 00:03:58,277 DEBUG [Listener at localhost/42423] util.CommonFSUtils(699): |----------eb1a798db4208e19623576a489e4fc10/ 2023-02-13 00:03:58,277 DEBUG [Listener at localhost/42423] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:03:58,280 INFO [Listener at localhost/42423] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 00:03:58,839 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,839 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,841 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,843 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:58,844 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1 2023-02-13 00:03:58,845 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4b8367f00edc3848dff018c6873d700 columnFamilyName f1 2023-02-13 00:03:58,849 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/testWithMockedMapReduceMultiRegion=b4b8367f00edc3848dff018c6873d700-5d8f917a0a9a45eeacb1077d8cee775b 2023-02-13 00:03:58,849 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(310): Store=b4b8367f00edc3848dff018c6873d700/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,849 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:58,850 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2 2023-02-13 00:03:58,851 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4b8367f00edc3848dff018c6873d700 columnFamilyName f2 2023-02-13 00:03:58,854 DEBUG [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/testWithMockedMapReduceMultiRegion=b4b8367f00edc3848dff018c6873d700-1588f637a4da4054a3c04a2e7cfe0cd7 2023-02-13 00:03:58,854 INFO [StoreOpener-b4b8367f00edc3848dff018c6873d700-1] regionserver.HStore(310): Store=b4b8367f00edc3848dff018c6873d700/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,855 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:58,855 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened b4b8367f00edc3848dff018c6873d700; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71357286, jitterRate=0.06330642104148865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:58,855 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for b4b8367f00edc3848dff018c6873d700: Writing region info on filesystem at 1676246638841Initializing all the Stores at 1676246638842 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638842Region opened successfully at 1676246638855 (+13 ms) 2023-02-13 00:03:58,863 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing b4b8367f00edc3848dff018c6873d700, disabling compactions & flushes 2023-02-13 00:03:58,863 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,863 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,863 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. after waiting 0 ms 2023-02-13 00:03:58,863 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,864 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:58,864 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for b4b8367f00edc3848dff018c6873d700: Waiting for close lock at 1676246638863Disabling compacts and flushes for region at 1676246638863Disabling writes for close at 1676246638863Writing region close event to WAL at 1676246638864 (+1 ms)Closed at 1676246638864 2023-02-13 00:03:58,865 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,865 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,866 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,868 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:58,869 DEBUG [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f1 2023-02-13 00:03:58,869 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e2cf7d8a28d1116b669efc70841c3ca columnFamilyName f1 2023-02-13 00:03:58,870 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(310): Store=1e2cf7d8a28d1116b669efc70841c3ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,870 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:58,871 DEBUG [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f2 2023-02-13 00:03:58,871 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e2cf7d8a28d1116b669efc70841c3ca columnFamilyName f2 2023-02-13 00:03:58,872 INFO [StoreOpener-1e2cf7d8a28d1116b669efc70841c3ca-1] regionserver.HStore(310): Store=1e2cf7d8a28d1116b669efc70841c3ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,872 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:58,872 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened 1e2cf7d8a28d1116b669efc70841c3ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62175326, jitterRate=-0.07351544499397278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:58,872 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for 1e2cf7d8a28d1116b669efc70841c3ca: Writing region info on filesystem at 1676246638866Initializing all the Stores at 1676246638867 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638867Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638867Region opened successfully at 1676246638872 (+5 ms) 2023-02-13 00:03:58,872 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing 1e2cf7d8a28d1116b669efc70841c3ca, disabling compactions & flushes 2023-02-13 00:03:58,872 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,872 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,872 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. after waiting 0 ms 2023-02-13 00:03:58,872 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,873 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:58,873 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for 1e2cf7d8a28d1116b669efc70841c3ca: Waiting for close lock at 1676246638872Disabling compacts and flushes for region at 1676246638872Disabling writes for close at 1676246638872Writing region close event to WAL at 1676246638873 (+1 ms)Closed at 1676246638873 2023-02-13 00:03:58,873 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,873 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,875 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,876 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:58,877 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1 2023-02-13 00:03:58,877 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f8ca51c7a9e530bdc9d85b4dff39ca6 columnFamilyName f1 2023-02-13 00:03:58,881 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/testWithMockedMapReduceMultiRegion=1f8ca51c7a9e530bdc9d85b4dff39ca6-344e66b0265e48a4969897e273a030f7 2023-02-13 00:03:58,881 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(310): Store=1f8ca51c7a9e530bdc9d85b4dff39ca6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,881 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:58,882 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2 2023-02-13 00:03:58,882 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f8ca51c7a9e530bdc9d85b4dff39ca6 columnFamilyName f2 2023-02-13 00:03:58,886 DEBUG [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/testWithMockedMapReduceMultiRegion=1f8ca51c7a9e530bdc9d85b4dff39ca6-0e566a323f034b6da0d8158b7304842d 2023-02-13 00:03:58,886 INFO [StoreOpener-1f8ca51c7a9e530bdc9d85b4dff39ca6-1] regionserver.HStore(310): Store=1f8ca51c7a9e530bdc9d85b4dff39ca6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,886 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:58,886 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened 1f8ca51c7a9e530bdc9d85b4dff39ca6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65669461, jitterRate=-0.021448776125907898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:58,886 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: Writing region info on filesystem at 1676246638875Initializing all the Stores at 1676246638875Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638875Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638875Region opened successfully at 1676246638886 (+11 ms) 2023-02-13 00:03:58,894 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing 1f8ca51c7a9e530bdc9d85b4dff39ca6, disabling compactions & flushes 2023-02-13 00:03:58,896 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,896 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,896 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. after waiting 0 ms 2023-02-13 00:03:58,896 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,897 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:58,897 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: Waiting for close lock at 1676246638894Disabling compacts and flushes for region at 1676246638894Disabling writes for close at 1676246638896 (+2 ms)Writing region close event to WAL at 1676246638897 (+1 ms)Closed at 1676246638897 2023-02-13 00:03:58,897 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,897 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,899 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,900 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:58,901 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1 2023-02-13 00:03:58,901 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb099a535604e954dbee3d51472c7e3f columnFamilyName f1 2023-02-13 00:03:58,905 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/testWithMockedMapReduceMultiRegion=cb099a535604e954dbee3d51472c7e3f-a695cf0cbe7345ca9265bd675f122820 2023-02-13 00:03:58,906 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(310): Store=cb099a535604e954dbee3d51472c7e3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,906 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:58,906 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2 2023-02-13 00:03:58,907 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb099a535604e954dbee3d51472c7e3f columnFamilyName f2 2023-02-13 00:03:58,911 DEBUG [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/testWithMockedMapReduceMultiRegion=cb099a535604e954dbee3d51472c7e3f-e13e135e286a4fb5be06771a9394fa3c 2023-02-13 00:03:58,911 INFO [StoreOpener-cb099a535604e954dbee3d51472c7e3f-1] regionserver.HStore(310): Store=cb099a535604e954dbee3d51472c7e3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,911 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:58,911 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened cb099a535604e954dbee3d51472c7e3f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71546241, jitterRate=0.06612206995487213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:58,912 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for cb099a535604e954dbee3d51472c7e3f: Writing region info on filesystem at 1676246638899Initializing all the Stores at 1676246638899Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638899Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638899Region opened successfully at 1676246638912 (+13 ms) 2023-02-13 00:03:58,924 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing cb099a535604e954dbee3d51472c7e3f, disabling compactions & flushes 2023-02-13 00:03:58,924 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,924 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,924 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. after waiting 0 ms 2023-02-13 00:03:58,924 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,925 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:58,925 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for cb099a535604e954dbee3d51472c7e3f: Waiting for close lock at 1676246638924Disabling compacts and flushes for region at 1676246638924Disabling writes for close at 1676246638924Writing region close event to WAL at 1676246638925 (+1 ms)Closed at 1676246638925 2023-02-13 00:03:58,926 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,926 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,928 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,929 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:58,930 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1 2023-02-13 00:03:58,931 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4239165e1e5f4b674ce0f5fa428b16c9 columnFamilyName f1 2023-02-13 00:03:58,935 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/testWithMockedMapReduceMultiRegion=4239165e1e5f4b674ce0f5fa428b16c9-8aeb940463924f5bb46e3cd2effdaaf3 2023-02-13 00:03:58,935 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(310): Store=4239165e1e5f4b674ce0f5fa428b16c9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,935 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:58,936 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2 2023-02-13 00:03:58,936 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4239165e1e5f4b674ce0f5fa428b16c9 columnFamilyName f2 2023-02-13 00:03:58,940 DEBUG [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/testWithMockedMapReduceMultiRegion=4239165e1e5f4b674ce0f5fa428b16c9-833d8343c00a4fabb239fb9ff61872d5 2023-02-13 00:03:58,941 INFO [StoreOpener-4239165e1e5f4b674ce0f5fa428b16c9-1] regionserver.HStore(310): Store=4239165e1e5f4b674ce0f5fa428b16c9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,941 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:58,941 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened 4239165e1e5f4b674ce0f5fa428b16c9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65958454, jitterRate=-0.017142444849014282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:58,941 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for 4239165e1e5f4b674ce0f5fa428b16c9: Writing region info on filesystem at 1676246638928Initializing all the Stores at 1676246638928Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638928Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638929 (+1 ms)Region opened successfully at 1676246638941 (+12 ms) 2023-02-13 00:03:58,957 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing 4239165e1e5f4b674ce0f5fa428b16c9, disabling compactions & flushes 2023-02-13 00:03:58,957 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,957 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,958 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. after waiting 0 ms 2023-02-13 00:03:58,958 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,960 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:58,961 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for 4239165e1e5f4b674ce0f5fa428b16c9: Waiting for close lock at 1676246638957Disabling compacts and flushes for region at 1676246638957Disabling writes for close at 1676246638958 (+1 ms)Writing region close event to WAL at 1676246638960 (+2 ms)Closed at 1676246638960 2023-02-13 00:03:58,961 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,961 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,963 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,965 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:58,966 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1 2023-02-13 00:03:58,966 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9cedd39285dfb3c89c03adecdb595ce columnFamilyName f1 2023-02-13 00:03:58,971 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/testWithMockedMapReduceMultiRegion=b9cedd39285dfb3c89c03adecdb595ce-d5c089478a4c437b8cf192bb0ec48ad9 2023-02-13 00:03:58,971 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(310): Store=b9cedd39285dfb3c89c03adecdb595ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,971 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:58,972 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2 2023-02-13 00:03:58,972 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9cedd39285dfb3c89c03adecdb595ce columnFamilyName f2 2023-02-13 00:03:58,977 DEBUG [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/testWithMockedMapReduceMultiRegion=b9cedd39285dfb3c89c03adecdb595ce-4eb063f1a7aa475d84840f3cdba64f2f 2023-02-13 00:03:58,977 INFO [StoreOpener-b9cedd39285dfb3c89c03adecdb595ce-1] regionserver.HStore(310): Store=b9cedd39285dfb3c89c03adecdb595ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,977 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:58,977 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened b9cedd39285dfb3c89c03adecdb595ce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68090352, jitterRate=0.014625310897827148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:58,977 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for b9cedd39285dfb3c89c03adecdb595ce: Writing region info on filesystem at 1676246638963Initializing all the Stores at 1676246638964 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638964Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638964Region opened successfully at 1676246638977 (+13 ms) 2023-02-13 00:03:58,987 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing b9cedd39285dfb3c89c03adecdb595ce, disabling compactions & flushes 2023-02-13 00:03:58,987 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,987 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,987 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. after waiting 0 ms 2023-02-13 00:03:58,987 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,988 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:58,988 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for b9cedd39285dfb3c89c03adecdb595ce: Waiting for close lock at 1676246638987Disabling compacts and flushes for region at 1676246638987Disabling writes for close at 1676246638987Writing region close event to WAL at 1676246638988 (+1 ms)Closed at 1676246638988 2023-02-13 00:03:58,989 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:58,989 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:58,990 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:58,992 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:58,993 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1 2023-02-13 00:03:58,993 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6152666b53bd923a6be5a62b862c77f columnFamilyName f1 2023-02-13 00:03:58,997 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/testWithMockedMapReduceMultiRegion=e6152666b53bd923a6be5a62b862c77f-cace60c4a44348748e04e5745b84a280 2023-02-13 00:03:58,997 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(310): Store=e6152666b53bd923a6be5a62b862c77f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:58,997 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:58,998 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2 2023-02-13 00:03:58,998 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6152666b53bd923a6be5a62b862c77f columnFamilyName f2 2023-02-13 00:03:59,003 DEBUG [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/testWithMockedMapReduceMultiRegion=e6152666b53bd923a6be5a62b862c77f-7161b66a997543aa83018c618bd889ed 2023-02-13 00:03:59,003 INFO [StoreOpener-e6152666b53bd923a6be5a62b862c77f-1] regionserver.HStore(310): Store=e6152666b53bd923a6be5a62b862c77f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,003 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:59,003 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened e6152666b53bd923a6be5a62b862c77f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65256428, jitterRate=-0.027603447437286377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:59,003 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for e6152666b53bd923a6be5a62b862c77f: Writing region info on filesystem at 1676246638990Initializing all the Stores at 1676246638991 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638991Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246638991Region opened successfully at 1676246639003 (+12 ms) 2023-02-13 00:03:59,015 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing e6152666b53bd923a6be5a62b862c77f, disabling compactions & flushes 2023-02-13 00:03:59,015 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,015 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,016 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. after waiting 0 ms 2023-02-13 00:03:59,016 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,020 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,020 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for e6152666b53bd923a6be5a62b862c77f: Waiting for close lock at 1676246639015Disabling compacts and flushes for region at 1676246639015Disabling writes for close at 1676246639016 (+1 ms)Writing region close event to WAL at 1676246639020 (+4 ms)Closed at 1676246639020 2023-02-13 00:03:59,021 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:59,021 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:59,026 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:59,028 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:59,029 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1 2023-02-13 00:03:59,029 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a8bfee6458dd1e6cd4a0683b422316c columnFamilyName f1 2023-02-13 00:03:59,034 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/testWithMockedMapReduceMultiRegion=2a8bfee6458dd1e6cd4a0683b422316c-5a105ec0cbd043a9af581f8fe88e7697 2023-02-13 00:03:59,034 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(310): Store=2a8bfee6458dd1e6cd4a0683b422316c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,034 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:59,035 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2 2023-02-13 00:03:59,035 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a8bfee6458dd1e6cd4a0683b422316c columnFamilyName f2 2023-02-13 00:03:59,039 DEBUG [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/testWithMockedMapReduceMultiRegion=2a8bfee6458dd1e6cd4a0683b422316c-5945cd427c8b43969202771f442d48dd 2023-02-13 00:03:59,039 INFO [StoreOpener-2a8bfee6458dd1e6cd4a0683b422316c-1] regionserver.HStore(310): Store=2a8bfee6458dd1e6cd4a0683b422316c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,040 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:59,040 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened 2a8bfee6458dd1e6cd4a0683b422316c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59078575, jitterRate=-0.1196606308221817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:59,040 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for 2a8bfee6458dd1e6cd4a0683b422316c: Writing region info on filesystem at 1676246639026Initializing all the Stores at 1676246639027 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246639027Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246639027Region opened successfully at 1676246639040 (+13 ms) 2023-02-13 00:03:59,049 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing 2a8bfee6458dd1e6cd4a0683b422316c, disabling compactions & flushes 2023-02-13 00:03:59,049 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,049 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,049 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. after waiting 0 ms 2023-02-13 00:03:59,049 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,052 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,052 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for 2a8bfee6458dd1e6cd4a0683b422316c: Waiting for close lock at 1676246639049Disabling compacts and flushes for region at 1676246639049Disabling writes for close at 1676246639049Writing region close event to WAL at 1676246639052 (+3 ms)Closed at 1676246639052 2023-02-13 00:03:59,053 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:59,053 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:59,055 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:59,057 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:59,058 DEBUG [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f1 2023-02-13 00:03:59,058 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb1a798db4208e19623576a489e4fc10 columnFamilyName f1 2023-02-13 00:03:59,058 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(310): Store=eb1a798db4208e19623576a489e4fc10/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,059 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:59,059 DEBUG [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f2 2023-02-13 00:03:59,060 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb1a798db4208e19623576a489e4fc10 columnFamilyName f2 2023-02-13 00:03:59,060 INFO [StoreOpener-eb1a798db4208e19623576a489e4fc10-1] regionserver.HStore(310): Store=eb1a798db4208e19623576a489e4fc10/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,060 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:59,060 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened eb1a798db4208e19623576a489e4fc10; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67456131, jitterRate=0.005174681544303894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:59,060 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for eb1a798db4208e19623576a489e4fc10: Writing region info on filesystem at 1676246639055Initializing all the Stores at 1676246639055Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246639055Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246639056 (+1 ms)Region opened successfully at 1676246639060 (+4 ms) 2023-02-13 00:03:59,061 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing eb1a798db4208e19623576a489e4fc10, disabling compactions & flushes 2023-02-13 00:03:59,061 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,061 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,061 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. after waiting 0 ms 2023-02-13 00:03:59,061 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,061 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,061 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for eb1a798db4208e19623576a489e4fc10: Waiting for close lock at 1676246639061Disabling compacts and flushes for region at 1676246639061Disabling writes for close at 1676246639061Writing region close event to WAL at 1676246639061Closed at 1676246639061 2023-02-13 00:03:59,062 DEBUG [Listener at localhost/42423] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:03:59,062 INFO [Listener at localhost/42423] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:03:59,064 DEBUG [Listener at localhost/42423] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:03:59,065 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:59,066 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1 2023-02-13 00:03:59,066 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ee031805692abffe8ee876aa480e4c0 columnFamilyName f1 2023-02-13 00:03:59,071 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/testWithMockedMapReduceMultiRegion=3ee031805692abffe8ee876aa480e4c0-aac5d4067db2400c8c300b63ffb66262 2023-02-13 00:03:59,071 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(310): Store=3ee031805692abffe8ee876aa480e4c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,071 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:59,072 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2 2023-02-13 00:03:59,072 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ee031805692abffe8ee876aa480e4c0 columnFamilyName f2 2023-02-13 00:03:59,076 DEBUG [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(539): loaded hdfs://localhost:36127/user/jenkins/test-data/130c5452-0ac6-2ef2-e0a8-84e8fac323c7/testWithMockedMapReduceMultiRegion/f8b544b3-8700-4a79-aecf-fa2cf98c0a58/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/testWithMockedMapReduceMultiRegion=3ee031805692abffe8ee876aa480e4c0-d19170757d6d4e47bf38deed86c07170 2023-02-13 00:03:59,077 INFO [StoreOpener-3ee031805692abffe8ee876aa480e4c0-1] regionserver.HStore(310): Store=3ee031805692abffe8ee876aa480e4c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:03:59,077 DEBUG [Listener at localhost/42423] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:03:59,077 INFO [Listener at localhost/42423] regionserver.HRegion(1071): Opened 3ee031805692abffe8ee876aa480e4c0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73309263, jitterRate=0.09239314496517181}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:03:59,077 DEBUG [Listener at localhost/42423] regionserver.HRegion(964): Region open journal for 3ee031805692abffe8ee876aa480e4c0: Writing region info on filesystem at 1676246639064Initializing all the Stores at 1676246639064Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246639065 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246639065Region opened successfully at 1676246639077 (+12 ms) 2023-02-13 00:03:59,093 DEBUG [Listener at localhost/42423] regionserver.HRegion(1603): Closing 3ee031805692abffe8ee876aa480e4c0, disabling compactions & flushes 2023-02-13 00:03:59,093 INFO [Listener at localhost/42423] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,093 DEBUG [Listener at localhost/42423] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,093 DEBUG [Listener at localhost/42423] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. after waiting 0 ms 2023-02-13 00:03:59,093 DEBUG [Listener at localhost/42423] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,094 INFO [Listener at localhost/42423] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,094 DEBUG [Listener at localhost/42423] regionserver.HRegion(1557): Region close journal for 3ee031805692abffe8ee876aa480e4c0: Waiting for close lock at 1676246639093Disabling compacts and flushes for region at 1676246639093Disabling writes for close at 1676246639093Writing region close event to WAL at 1676246639094 (+1 ms)Closed at 1676246639094 2023-02-13 00:03:59,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-13 00:03:59,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,105 INFO [Listener at localhost/42423] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:59,112 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246639112"}]},"ts":"1676246639112"} 2023-02-13 00:03:59,113 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-13 00:03:59,115 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-13 00:03:59,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, UNASSIGN}] 2023-02-13 00:03:59,118 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, UNASSIGN 2023-02-13 00:03:59,118 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, UNASSIGN 2023-02-13 00:03:59,118 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, UNASSIGN 2023-02-13 00:03:59,118 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, UNASSIGN 2023-02-13 00:03:59,118 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, UNASSIGN 2023-02-13 00:03:59,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cb099a535604e954dbee3d51472c7e3f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:59,119 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639119"}]},"ts":"1676246639119"} 2023-02-13 00:03:59,119 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=4239165e1e5f4b674ce0f5fa428b16c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=eb1a798db4208e19623576a489e4fc10, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,119 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639119"}]},"ts":"1676246639119"} 2023-02-13 00:03:59,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1f8ca51c7a9e530bdc9d85b4dff39ca6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=1e2cf7d8a28d1116b669efc70841c3ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:59,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246639119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639119"}]},"ts":"1676246639119"} 2023-02-13 00:03:59,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246639119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639119"}]},"ts":"1676246639119"} 2023-02-13 00:03:59,119 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639119"}]},"ts":"1676246639119"} 2023-02-13 00:03:59,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure cb099a535604e954dbee3d51472c7e3f, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:59,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure 4239165e1e5f4b674ce0f5fa428b16c9, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:59,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure eb1a798db4208e19623576a489e4fc10, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:59,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=34, state=RUNNABLE; CloseRegionProcedure 1e2cf7d8a28d1116b669efc70841c3ca, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:59,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=37, state=RUNNABLE; CloseRegionProcedure 1f8ca51c7a9e530bdc9d85b4dff39ca6, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:59,124 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, UNASSIGN 2023-02-13 00:03:59,124 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, UNASSIGN 2023-02-13 00:03:59,124 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b9cedd39285dfb3c89c03adecdb595ce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:59,124 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639124"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639124"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639124"}]},"ts":"1676246639124"} 2023-02-13 00:03:59,125 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, UNASSIGN 2023-02-13 00:03:59,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e6152666b53bd923a6be5a62b862c77f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639125"}]},"ts":"1676246639125"} 2023-02-13 00:03:59,125 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, UNASSIGN 2023-02-13 00:03:59,125 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3ee031805692abffe8ee876aa480e4c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:59,125 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639125"}]},"ts":"1676246639125"} 2023-02-13 00:03:59,126 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, UNASSIGN 2023-02-13 00:03:59,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2a8bfee6458dd1e6cd4a0683b422316c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure b9cedd39285dfb3c89c03adecdb595ce, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:59,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639126"}]},"ts":"1676246639126"} 2023-02-13 00:03:59,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b4b8367f00edc3848dff018c6873d700, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:59,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure e6152666b53bd923a6be5a62b862c77f, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:59,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246639126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246639126"}]},"ts":"1676246639126"} 2023-02-13 00:03:59,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 3ee031805692abffe8ee876aa480e4c0, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:59,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 2a8bfee6458dd1e6cd4a0683b422316c, server=jenkins-hbase4.apache.org,42213,1676246634611}] 2023-02-13 00:03:59,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure b4b8367f00edc3848dff018c6873d700, server=jenkins-hbase4.apache.org,36715,1676246634643}] 2023-02-13 00:03:59,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:59,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:59,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eb1a798db4208e19623576a489e4fc10, disabling compactions & flushes 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b9cedd39285dfb3c89c03adecdb595ce, disabling compactions & flushes 2023-02-13 00:03:59,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. after waiting 0 ms 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. after waiting 0 ms 2023-02-13 00:03:59,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 00:03:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10. 2023-02-13 00:03:59,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eb1a798db4208e19623576a489e4fc10: Waiting for close lock at 1676246639274Running coprocessor pre-close hooks at 1676246639274Disabling compacts and flushes for region at 1676246639274Disabling writes for close at 1676246639274Writing region close event to WAL at 1676246639274Running coprocessor post-close hooks at 1676246639278 (+4 ms)Closed at 1676246639278 2023-02-13 00:03:59,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce. 2023-02-13 00:03:59,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b9cedd39285dfb3c89c03adecdb595ce: Waiting for close lock at 1676246639274Running coprocessor pre-close hooks at 1676246639274Disabling compacts and flushes for region at 1676246639274Disabling writes for close at 1676246639274Writing region close event to WAL at 1676246639275 (+1 ms)Running coprocessor post-close hooks at 1676246639278 (+3 ms)Closed at 1676246639278 2023-02-13 00:03:59,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:59,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:59,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1f8ca51c7a9e530bdc9d85b4dff39ca6, disabling compactions & flushes 2023-02-13 00:03:59,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:59,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:59,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. after waiting 0 ms 2023-02-13 00:03:59,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:59,279 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=eb1a798db4208e19623576a489e4fc10, regionState=CLOSED 2023-02-13 00:03:59,280 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246639279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639279"}]},"ts":"1676246639279"} 2023-02-13 00:03:59,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:59,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:59,280 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b9cedd39285dfb3c89c03adecdb595ce, regionState=CLOSED 2023-02-13 00:03:59,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb099a535604e954dbee3d51472c7e3f, disabling compactions & flushes 2023-02-13 00:03:59,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:59,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:59,280 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639280"}]},"ts":"1676246639280"} 2023-02-13 00:03:59,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. after waiting 0 ms 2023-02-13 00:03:59,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:59,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-13 00:03:59,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure eb1a798db4208e19623576a489e4fc10, server=jenkins-hbase4.apache.org,42213,1676246634611 in 159 msec 2023-02-13 00:03:59,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 00:03:59,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure b9cedd39285dfb3c89c03adecdb595ce, server=jenkins-hbase4.apache.org,36715,1676246634643 in 156 msec 2023-02-13 00:03:59,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=eb1a798db4208e19623576a489e4fc10, UNASSIGN in 167 msec 2023-02-13 00:03:59,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b9cedd39285dfb3c89c03adecdb595ce, UNASSIGN in 167 msec 2023-02-13 00:03:59,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6. 2023-02-13 00:03:59,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1f8ca51c7a9e530bdc9d85b4dff39ca6: Waiting for close lock at 1676246639279Running coprocessor pre-close hooks at 1676246639279Disabling compacts and flushes for region at 1676246639279Disabling writes for close at 1676246639279Writing region close event to WAL at 1676246639280 (+1 ms)Running coprocessor post-close hooks at 1676246639285 (+5 ms)Closed at 1676246639285 2023-02-13 00:03:59,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:59,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:59,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4239165e1e5f4b674ce0f5fa428b16c9, disabling compactions & flushes 2023-02-13 00:03:59,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:59,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:59,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. after waiting 0 ms 2023-02-13 00:03:59,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:59,287 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1f8ca51c7a9e530bdc9d85b4dff39ca6, regionState=CLOSED 2023-02-13 00:03:59,287 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639286"}]},"ts":"1676246639286"} 2023-02-13 00:03:59,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f. 2023-02-13 00:03:59,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb099a535604e954dbee3d51472c7e3f: Waiting for close lock at 1676246639280Running coprocessor pre-close hooks at 1676246639280Disabling compacts and flushes for region at 1676246639280Disabling writes for close at 1676246639280Writing region close event to WAL at 1676246639282 (+2 ms)Running coprocessor post-close hooks at 1676246639287 (+5 ms)Closed at 1676246639287 2023-02-13 00:03:59,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:59,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:59,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b4b8367f00edc3848dff018c6873d700, disabling compactions & flushes 2023-02-13 00:03:59,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:59,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:59,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. after waiting 0 ms 2023-02-13 00:03:59,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:59,289 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cb099a535604e954dbee3d51472c7e3f, regionState=CLOSED 2023-02-13 00:03:59,289 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639289"}]},"ts":"1676246639289"} 2023-02-13 00:03:59,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=37 2023-02-13 00:03:59,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=37, state=SUCCESS; CloseRegionProcedure 1f8ca51c7a9e530bdc9d85b4dff39ca6, server=jenkins-hbase4.apache.org,42213,1676246634611 in 165 msec 2023-02-13 00:03:59,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f8ca51c7a9e530bdc9d85b4dff39ca6, UNASSIGN in 174 msec 2023-02-13 00:03:59,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-13 00:03:59,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure cb099a535604e954dbee3d51472c7e3f, server=jenkins-hbase4.apache.org,36715,1676246634643 in 169 msec 2023-02-13 00:03:59,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9. 2023-02-13 00:03:59,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4239165e1e5f4b674ce0f5fa428b16c9: Waiting for close lock at 1676246639286Running coprocessor pre-close hooks at 1676246639286Disabling compacts and flushes for region at 1676246639286Disabling writes for close at 1676246639287 (+1 ms)Writing region close event to WAL at 1676246639288 (+1 ms)Running coprocessor post-close hooks at 1676246639292 (+4 ms)Closed at 1676246639292 2023-02-13 00:03:59,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cb099a535604e954dbee3d51472c7e3f, UNASSIGN in 176 msec 2023-02-13 00:03:59,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:59,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2a8bfee6458dd1e6cd4a0683b422316c, disabling compactions & flushes 2023-02-13 00:03:59,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. after waiting 0 ms 2023-02-13 00:03:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=4239165e1e5f4b674ce0f5fa428b16c9, regionState=CLOSED 2023-02-13 00:03:59,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639293"}]},"ts":"1676246639293"} 2023-02-13 00:03:59,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-13 00:03:59,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure 4239165e1e5f4b674ce0f5fa428b16c9, server=jenkins-hbase4.apache.org,42213,1676246634611 in 174 msec 2023-02-13 00:03:59,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4239165e1e5f4b674ce0f5fa428b16c9, UNASSIGN in 180 msec 2023-02-13 00:03:59,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c. 2023-02-13 00:03:59,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2a8bfee6458dd1e6cd4a0683b422316c: Waiting for close lock at 1676246639293Running coprocessor pre-close hooks at 1676246639293Disabling compacts and flushes for region at 1676246639293Disabling writes for close at 1676246639293Writing region close event to WAL at 1676246639295 (+2 ms)Running coprocessor post-close hooks at 1676246639299 (+4 ms)Closed at 1676246639299 2023-02-13 00:03:59,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:59,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:59,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e6152666b53bd923a6be5a62b862c77f, disabling compactions & flushes 2023-02-13 00:03:59,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. after waiting 0 ms 2023-02-13 00:03:59,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2a8bfee6458dd1e6cd4a0683b422316c, regionState=CLOSED 2023-02-13 00:03:59,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639301"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639301"}]},"ts":"1676246639301"} 2023-02-13 00:03:59,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-13 00:03:59,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 2a8bfee6458dd1e6cd4a0683b422316c, server=jenkins-hbase4.apache.org,42213,1676246634611 in 174 msec 2023-02-13 00:03:59,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2a8bfee6458dd1e6cd4a0683b422316c, UNASSIGN in 187 msec 2023-02-13 00:03:59,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700. 2023-02-13 00:03:59,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b4b8367f00edc3848dff018c6873d700: Waiting for close lock at 1676246639288Running coprocessor pre-close hooks at 1676246639288Disabling compacts and flushes for region at 1676246639288Disabling writes for close at 1676246639289 (+1 ms)Writing region close event to WAL at 1676246639300 (+11 ms)Running coprocessor post-close hooks at 1676246639309 (+9 ms)Closed at 1676246639309 2023-02-13 00:03:59,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:59,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1e2cf7d8a28d1116b669efc70841c3ca, disabling compactions & flushes 2023-02-13 00:03:59,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. after waiting 0 ms 2023-02-13 00:03:59,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:59,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b4b8367f00edc3848dff018c6873d700, regionState=CLOSED 2023-02-13 00:03:59,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639311"}]},"ts":"1676246639311"} 2023-02-13 00:03:59,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 00:03:59,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca. 2023-02-13 00:03:59,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1e2cf7d8a28d1116b669efc70841c3ca: Waiting for close lock at 1676246639311Running coprocessor pre-close hooks at 1676246639311Disabling compacts and flushes for region at 1676246639311Disabling writes for close at 1676246639311Writing region close event to WAL at 1676246639311Running coprocessor post-close hooks at 1676246639314 (+3 ms)Closed at 1676246639314 2023-02-13 00:03:59,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-13 00:03:59,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure b4b8367f00edc3848dff018c6873d700, server=jenkins-hbase4.apache.org,36715,1676246634643 in 181 msec 2023-02-13 00:03:59,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:59,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:59,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3ee031805692abffe8ee876aa480e4c0, disabling compactions & flushes 2023-02-13 00:03:59,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. after waiting 0 ms 2023-02-13 00:03:59,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f. 2023-02-13 00:03:59,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=1e2cf7d8a28d1116b669efc70841c3ca, regionState=CLOSED 2023-02-13 00:03:59,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e6152666b53bd923a6be5a62b862c77f: Waiting for close lock at 1676246639300Running coprocessor pre-close hooks at 1676246639300Disabling compacts and flushes for region at 1676246639300Disabling writes for close at 1676246639301 (+1 ms)Writing region close event to WAL at 1676246639309 (+8 ms)Running coprocessor post-close hooks at 1676246639317 (+8 ms)Closed at 1676246639317 2023-02-13 00:03:59,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676246639317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639317"}]},"ts":"1676246639317"} 2023-02-13 00:03:59,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4b8367f00edc3848dff018c6873d700, UNASSIGN in 200 msec 2023-02-13 00:03:59,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:59,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e6152666b53bd923a6be5a62b862c77f, regionState=CLOSED 2023-02-13 00:03:59,319 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639319"}]},"ts":"1676246639319"} 2023-02-13 00:03:59,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=34 2023-02-13 00:03:59,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=34, state=SUCCESS; CloseRegionProcedure 1e2cf7d8a28d1116b669efc70841c3ca, server=jenkins-hbase4.apache.org,36715,1676246634643 in 195 msec 2023-02-13 00:03:59,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e2cf7d8a28d1116b669efc70841c3ca, UNASSIGN in 204 msec 2023-02-13 00:03:59,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:03:59,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0. 2023-02-13 00:03:59,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3ee031805692abffe8ee876aa480e4c0: Waiting for close lock at 1676246639317Running coprocessor pre-close hooks at 1676246639317Disabling compacts and flushes for region at 1676246639317Disabling writes for close at 1676246639317Writing region close event to WAL at 1676246639318 (+1 ms)Running coprocessor post-close hooks at 1676246639322 (+4 ms)Closed at 1676246639322 2023-02-13 00:03:59,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-13 00:03:59,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure e6152666b53bd923a6be5a62b862c77f, server=jenkins-hbase4.apache.org,42213,1676246634611 in 195 msec 2023-02-13 00:03:59,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:59,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e6152666b53bd923a6be5a62b862c77f, UNASSIGN in 206 msec 2023-02-13 00:03:59,323 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3ee031805692abffe8ee876aa480e4c0, regionState=CLOSED 2023-02-13 00:03:59,324 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676246639323"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246639323"}]},"ts":"1676246639323"} 2023-02-13 00:03:59,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-13 00:03:59,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 3ee031805692abffe8ee876aa480e4c0, server=jenkins-hbase4.apache.org,36715,1676246634643 in 198 msec 2023-02-13 00:03:59,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-13 00:03:59,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3ee031805692abffe8ee876aa480e4c0, UNASSIGN in 210 msec 2023-02-13 00:03:59,328 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246639327"}]},"ts":"1676246639327"} 2023-02-13 00:03:59,329 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-13 00:03:59,330 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-13 00:03:59,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 225 msec 2023-02-13 00:03:59,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 00:03:59,413 INFO [Listener at localhost/42423] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-13 00:03:59,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,417 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,417 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:59,427 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:59,430 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/recovered.edits] 2023-02-13 00:03:59,432 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/recovered.edits] 2023-02-13 00:03:59,432 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/recovered.edits] 2023-02-13 00:03:59,433 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/recovered.edits] 2023-02-13 00:03:59,433 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/recovered.edits] 2023-02-13 00:03:59,433 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/recovered.edits] 2023-02-13 00:03:59,433 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/recovered.edits] 2023-02-13 00:03:59,435 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/recovered.edits] 2023-02-13 00:03:59,438 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/344e66b0265e48a4969897e273a030f7 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/344e66b0265e48a4969897e273a030f7 2023-02-13 00:03:59,439 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/304b0c6180de4fe08c67bd3e611cc123 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/304b0c6180de4fe08c67bd3e611cc123 2023-02-13 00:03:59,441 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/2453ef232e9c4014919e34c16592cfbe to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/2453ef232e9c4014919e34c16592cfbe 2023-02-13 00:03:59,441 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/ff109230fbd34dd0b73ceff8ee1e5b3c to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f1/ff109230fbd34dd0b73ceff8ee1e5b3c 2023-02-13 00:03:59,441 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/aac5d4067db2400c8c300b63ffb66262 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f1/aac5d4067db2400c8c300b63ffb66262 2023-02-13 00:03:59,441 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/cace60c4a44348748e04e5745b84a280 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/cace60c4a44348748e04e5745b84a280 2023-02-13 00:03:59,442 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/1a737f333a134a01986ca6a99cf77be3 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/1a737f333a134a01986ca6a99cf77be3 2023-02-13 00:03:59,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/5d8f917a0a9a45eeacb1077d8cee775b to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/5d8f917a0a9a45eeacb1077d8cee775b 2023-02-13 00:03:59,444 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/8aeb940463924f5bb46e3cd2effdaaf3 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f1/8aeb940463924f5bb46e3cd2effdaaf3 2023-02-13 00:03:59,444 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/recovered.edits/6.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca/recovered.edits/6.seqid 2023-02-13 00:03:59,445 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/a695cf0cbe7345ca9265bd675f122820 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f1/a695cf0cbe7345ca9265bd675f122820 2023-02-13 00:03:59,445 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/85f04e0d0d7349ca909f9291e1cd3bc4 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f1/85f04e0d0d7349ca909f9291e1cd3bc4 2023-02-13 00:03:59,445 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5a105ec0cbd043a9af581f8fe88e7697 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5a105ec0cbd043a9af581f8fe88e7697 2023-02-13 00:03:59,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e2cf7d8a28d1116b669efc70841c3ca 2023-02-13 00:03:59,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:59,445 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/f96df1f78ce1463d852e8f50ecbdd06e to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f1/f96df1f78ce1463d852e8f50ecbdd06e 2023-02-13 00:03:59,447 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/0e566a323f034b6da0d8158b7304842d to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/0e566a323f034b6da0d8158b7304842d 2023-02-13 00:03:59,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5e659587a3f94b759dc9c128e32f1057 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f1/5e659587a3f94b759dc9c128e32f1057 2023-02-13 00:03:59,448 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/68970772a4484d4c860d981d24ef9a5c to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/68970772a4484d4c860d981d24ef9a5c 2023-02-13 00:03:59,449 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/63cce4cdf7ee45b7bff7c41685309a75 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/63cce4cdf7ee45b7bff7c41685309a75 2023-02-13 00:03:59,450 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/750f289589a64e1da128bfd3fbbcc874 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/f2/750f289589a64e1da128bfd3fbbcc874 2023-02-13 00:03:59,450 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/recovered.edits] 2023-02-13 00:03:59,452 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/706cab2fef8340b2b2a98bc0f89d0376 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/706cab2fef8340b2b2a98bc0f89d0376 2023-02-13 00:03:59,452 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/d19170757d6d4e47bf38deed86c07170 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/f2/d19170757d6d4e47bf38deed86c07170 2023-02-13 00:03:59,452 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/833d8343c00a4fabb239fb9ff61872d5 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/f2/833d8343c00a4fabb239fb9ff61872d5 2023-02-13 00:03:59,453 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/6805628bfc364585b6e41d0bae1ee760 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/6805628bfc364585b6e41d0bae1ee760 2023-02-13 00:03:59,453 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/1588f637a4da4054a3c04a2e7cfe0cd7 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/1588f637a4da4054a3c04a2e7cfe0cd7 2023-02-13 00:03:59,453 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/5945cd427c8b43969202771f442d48dd to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/5945cd427c8b43969202771f442d48dd 2023-02-13 00:03:59,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/7161b66a997543aa83018c618bd889ed to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/f2/7161b66a997543aa83018c618bd889ed 2023-02-13 00:03:59,457 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6/recovered.edits/12.seqid 2023-02-13 00:03:59,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/e13e135e286a4fb5be06771a9394fa3c to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/f2/e13e135e286a4fb5be06771a9394fa3c 2023-02-13 00:03:59,458 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/85852e3a5a5d4ce3b70262a250b3acdb to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/f2/85852e3a5a5d4ce3b70262a250b3acdb 2023-02-13 00:03:59,458 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/e345e8a9936048cc99cb82f11a7a5c38 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/f2/e345e8a9936048cc99cb82f11a7a5c38 2023-02-13 00:03:59,459 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f8ca51c7a9e530bdc9d85b4dff39ca6 2023-02-13 00:03:59,459 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:59,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/06fbb54f11ff42ce8b0f254195b853ee to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/06fbb54f11ff42ce8b0f254195b853ee 2023-02-13 00:03:59,460 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0/recovered.edits/12.seqid 2023-02-13 00:03:59,461 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9/recovered.edits/12.seqid 2023-02-13 00:03:59,461 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/3ee031805692abffe8ee876aa480e4c0 2023-02-13 00:03:59,463 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/4239165e1e5f4b674ce0f5fa428b16c9 2023-02-13 00:03:59,463 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/d5c089478a4c437b8cf192bb0ec48ad9 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f1/d5c089478a4c437b8cf192bb0ec48ad9 2023-02-13 00:03:59,464 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f1, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/f2, FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/recovered.edits] 2023-02-13 00:03:59,464 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f/recovered.edits/12.seqid 2023-02-13 00:03:59,465 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c/recovered.edits/12.seqid 2023-02-13 00:03:59,465 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/e6152666b53bd923a6be5a62b862c77f 2023-02-13 00:03:59,465 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f/recovered.edits/12.seqid 2023-02-13 00:03:59,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700/recovered.edits/12.seqid 2023-02-13 00:03:59,466 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/2a8bfee6458dd1e6cd4a0683b422316c 2023-02-13 00:03:59,466 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/cb099a535604e954dbee3d51472c7e3f 2023-02-13 00:03:59,466 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4b8367f00edc3848dff018c6873d700 2023-02-13 00:03:59,468 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4043bfa5060e4634a603d1f24fc04d54 to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4043bfa5060e4634a603d1f24fc04d54 2023-02-13 00:03:59,469 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4eb063f1a7aa475d84840f3cdba64f2f to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/f2/4eb063f1a7aa475d84840f3cdba64f2f 2023-02-13 00:03:59,471 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/recovered.edits/6.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10/recovered.edits/6.seqid 2023-02-13 00:03:59,471 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/eb1a798db4208e19623576a489e4fc10 2023-02-13 00:03:59,472 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/recovered.edits/12.seqid to hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/archive/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce/recovered.edits/12.seqid 2023-02-13 00:03:59,472 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/.tmp/data/default/testWithMockedMapReduceMultiRegion/b9cedd39285dfb3c89c03adecdb595ce 2023-02-13 00:03:59,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 00:03:59,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,477 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-13 00:03:59,480 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,481 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246639481"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 00:03:59,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1e2cf7d8a28d1116b669efc70841c3ca, NAME => 'testWithMockedMapReduceMultiRegion,,1676246635880.1e2cf7d8a28d1116b669efc70841c3ca.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 4239165e1e5f4b674ce0f5fa428b16c9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676246635880.4239165e1e5f4b674ce0f5fa428b16c9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => cb099a535604e954dbee3d51472c7e3f, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676246635880.cb099a535604e954dbee3d51472c7e3f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 1f8ca51c7a9e530bdc9d85b4dff39ca6, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676246635880.1f8ca51c7a9e530bdc9d85b4dff39ca6.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => b4b8367f00edc3848dff018c6873d700, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676246635880.b4b8367f00edc3848dff018c6873d700.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2a8bfee6458dd1e6cd4a0683b422316c, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676246635880.2a8bfee6458dd1e6cd4a0683b422316c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 3ee031805692abffe8ee876aa480e4c0, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676246635880.3ee031805692abffe8ee876aa480e4c0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => e6152666b53bd923a6be5a62b862c77f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676246635880.e6152666b53bd923a6be5a62b862c77f.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => b9cedd39285dfb3c89c03adecdb595ce, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676246635880.b9cedd39285dfb3c89c03adecdb595ce.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => eb1a798db4208e19623576a489e4fc10, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676246635880.eb1a798db4208e19623576a489e4fc10.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 00:03:59,483 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-13 00:03:59,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676246639483"}]},"ts":"9223372036854775807"} 2023-02-13 00:03:59,484 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-13 00:03:59,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 00:03:59,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 00:03:59,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 140 msec 2023-02-13 00:03:59,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 00:03:59,721 INFO [Listener at localhost/42423] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-13 00:03:59,721 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:03:59,721 INFO [Listener at localhost/42423] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:03:59,721 DEBUG [Listener at localhost/42423] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36ee9869 to 127.0.0.1:63953 2023-02-13 00:03:59,722 DEBUG [Listener at localhost/42423] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:59,722 DEBUG [Listener at localhost/42423] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:03:59,722 DEBUG [Listener at localhost/42423] util.JVMClusterUtil(257): Found active master hash=1047275316, stopped=false 2023-02-13 00:03:59,722 INFO [Listener at localhost/42423] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:03:59,830 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:59,830 INFO [Listener at localhost/42423] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:03:59,830 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:59,830 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:03:59,830 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:03:59,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:59,832 DEBUG [Listener at localhost/42423] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x354e260b to 127.0.0.1:63953 2023-02-13 00:03:59,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:59,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:03:59,832 DEBUG [Listener at localhost/42423] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:59,833 INFO [Listener at localhost/42423] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42213,1676246634611' ***** 2023-02-13 00:03:59,833 INFO [Listener at localhost/42423] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:59,833 INFO [Listener at localhost/42423] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36715,1676246634643' ***** 2023-02-13 00:03:59,833 INFO [Listener at localhost/42423] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:03:59,833 INFO [RS:0;jenkins-hbase4:42213] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:59,833 INFO [RS:1;jenkins-hbase4:36715] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:03:59,833 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:59,833 INFO [RS:1;jenkins-hbase4:36715] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:59,833 INFO [RS:0;jenkins-hbase4:42213] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:03:59,834 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:03:59,834 INFO [RS:0;jenkins-hbase4:42213] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:59,834 INFO [RS:1;jenkins-hbase4:36715] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:03:59,835 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,835 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(3304): Received CLOSE for 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:59,835 DEBUG [RS:0;jenkins-hbase4:42213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x162b7908 to 127.0.0.1:63953 2023-02-13 00:03:59,835 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:03:59,835 DEBUG [RS:0;jenkins-hbase4:42213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:59,836 DEBUG [RS:1;jenkins-hbase4:36715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x453f9310 to 127.0.0.1:63953 2023-02-13 00:03:59,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7ffac005f49dd51f5e001405d7af1599, disabling compactions & flushes 2023-02-13 00:03:59,836 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42213,1676246634611; all regions closed. 2023-02-13 00:03:59,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:59,836 DEBUG [RS:1;jenkins-hbase4:36715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:59,836 INFO [RS:1;jenkins-hbase4:36715] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:59,836 INFO [RS:1;jenkins-hbase4:36715] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:59,836 INFO [RS:1;jenkins-hbase4:36715] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:59,836 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:03:59,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:59,837 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 00:03:59,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. after waiting 0 ms 2023-02-13 00:03:59,837 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 7ffac005f49dd51f5e001405d7af1599=hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599.} 2023-02-13 00:03:59,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:59,839 DEBUG [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1505): Waiting on 1588230740, 7ffac005f49dd51f5e001405d7af1599 2023-02-13 00:03:59,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7ffac005f49dd51f5e001405d7af1599 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:03:59,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:03:59,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:03:59,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:03:59,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:03:59,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:03:59,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-13 00:03:59,844 DEBUG [RS:0;jenkins-hbase4:42213] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/oldWALs 2023-02-13 00:03:59,844 INFO [RS:0;jenkins-hbase4:42213] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42213%2C1676246634611:(num 1676246635936) 2023-02-13 00:03:59,844 DEBUG [RS:0;jenkins-hbase4:42213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:03:59,844 INFO [RS:0;jenkins-hbase4:42213] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:59,844 INFO [RS:0;jenkins-hbase4:42213] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:03:59,844 INFO [RS:0;jenkins-hbase4:42213] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:03:59,844 INFO [RS:0;jenkins-hbase4:42213] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:03:59,844 INFO [RS:0;jenkins-hbase4:42213] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:03:59,844 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:03:59,845 INFO [RS:0;jenkins-hbase4:42213] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42213 2023-02-13 00:03:59,852 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/.tmp/info/6f7fad21d1154072bc554f8a5aad730b 2023-02-13 00:03:59,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/.tmp/info/d436726b575b4796a454c689a48feb7a 2023-02-13 00:03:59,856 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f7fad21d1154072bc554f8a5aad730b 2023-02-13 00:03:59,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/.tmp/info/d436726b575b4796a454c689a48feb7a as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/info/d436726b575b4796a454c689a48feb7a 2023-02-13 00:03:59,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/info/d436726b575b4796a454c689a48feb7a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:03:59,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7ffac005f49dd51f5e001405d7af1599 in 22ms, sequenceid=6, compaction requested=false 2023-02-13 00:03:59,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/.tmp/rep_barrier/e88110cca8ec40fba72696e4828bab88 2023-02-13 00:03:59,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/namespace/7ffac005f49dd51f5e001405d7af1599/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:03:59,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:59,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7ffac005f49dd51f5e001405d7af1599: Waiting for close lock at 1676246639836Running coprocessor pre-close hooks at 1676246639836Disabling compacts and flushes for region at 1676246639836Disabling writes for close at 1676246639837 (+1 ms)Obtaining lock to block concurrent updates at 1676246639839 (+2 ms)Preparing flush snapshotting stores in 7ffac005f49dd51f5e001405d7af1599 at 1676246639839Finished memstore snapshotting hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246639839Flushing stores of hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. at 1676246639840 (+1 ms)Flushing 7ffac005f49dd51f5e001405d7af1599/info: creating writer at 1676246639840Flushing 7ffac005f49dd51f5e001405d7af1599/info: appending metadata at 1676246639843 (+3 ms)Flushing 7ffac005f49dd51f5e001405d7af1599/info: closing flushed file at 1676246639843Flushing 7ffac005f49dd51f5e001405d7af1599/info: reopening flushed file at 1676246639857 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7ffac005f49dd51f5e001405d7af1599 in 22ms, sequenceid=6, compaction requested=false at 1676246639861 (+4 ms)Writing region close event to WAL at 1676246639861Running coprocessor post-close hooks at 1676246639864 (+3 ms)Closed at 1676246639865 (+1 ms) 2023-02-13 00:03:59,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246635221.7ffac005f49dd51f5e001405d7af1599. 2023-02-13 00:03:59,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e88110cca8ec40fba72696e4828bab88 2023-02-13 00:03:59,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/.tmp/table/3840c12d8d704fd58c4f5389e1d7e571 2023-02-13 00:03:59,878 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3840c12d8d704fd58c4f5389e1d7e571 2023-02-13 00:03:59,879 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/.tmp/info/6f7fad21d1154072bc554f8a5aad730b as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/info/6f7fad21d1154072bc554f8a5aad730b 2023-02-13 00:03:59,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f7fad21d1154072bc554f8a5aad730b 2023-02-13 00:03:59,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/info/6f7fad21d1154072bc554f8a5aad730b, entries=30, sequenceid=57, filesize=8.3 K 2023-02-13 00:03:59,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/.tmp/rep_barrier/e88110cca8ec40fba72696e4828bab88 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/rep_barrier/e88110cca8ec40fba72696e4828bab88 2023-02-13 00:03:59,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e88110cca8ec40fba72696e4828bab88 2023-02-13 00:03:59,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/rep_barrier/e88110cca8ec40fba72696e4828bab88, entries=10, sequenceid=57, filesize=6.1 K 2023-02-13 00:03:59,889 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/.tmp/table/3840c12d8d704fd58c4f5389e1d7e571 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/table/3840c12d8d704fd58c4f5389e1d7e571 2023-02-13 00:03:59,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3840c12d8d704fd58c4f5389e1d7e571 2023-02-13 00:03:59,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/table/3840c12d8d704fd58c4f5389e1d7e571, entries=13, sequenceid=57, filesize=6.1 K 2023-02-13 00:03:59,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=57, compaction requested=false 2023-02-13 00:03:59,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 00:03:59,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:03:59,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:59,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246639837Running coprocessor pre-close hooks at 1676246639837Disabling compacts and flushes for region at 1676246639837Disabling writes for close at 1676246639839 (+2 ms)Obtaining lock to block concurrent updates at 1676246639840 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676246639840Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676246639840Flushing stores of hbase:meta,,1.1588230740 at 1676246639841 (+1 ms)Flushing 1588230740/info: creating writer at 1676246639841Flushing 1588230740/info: appending metadata at 1676246639843 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676246639843Flushing 1588230740/rep_barrier: creating writer at 1676246639856 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676246639858 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676246639858Flushing 1588230740/table: creating writer at 1676246639867 (+9 ms)Flushing 1588230740/table: appending metadata at 1676246639869 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676246639869Flushing 1588230740/info: reopening flushed file at 1676246639880 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676246639884 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676246639889 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=57, compaction requested=false at 1676246639893 (+4 ms)Writing region close event to WAL at 1676246639898 (+5 ms)Running coprocessor post-close hooks at 1676246639901 (+3 ms)Closed at 1676246639902 (+1 ms) 2023-02-13 00:03:59,903 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:03:59,918 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:59,924 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:03:59,930 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:59,930 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,930 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42213,1676246634611 2023-02-13 00:03:59,930 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e1dd612 rejected from java.util.concurrent.ThreadPoolExecutor@3a225509[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:59,930 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:59,931 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:03:59,931 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e680c42 rejected from java.util.concurrent.ThreadPoolExecutor@3a225509[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:03:59,931 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42213,1676246634611] 2023-02-13 00:03:59,931 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42213,1676246634611; numProcessing=1 2023-02-13 00:03:59,979 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 00:03:59,979 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 00:04:00,039 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36715,1676246634643; all regions closed. 2023-02-13 00:04:00,045 DEBUG [RS:1;jenkins-hbase4:36715] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/oldWALs 2023-02-13 00:04:00,045 INFO [RS:1;jenkins-hbase4:36715] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36715%2C1676246634643.meta:.meta(num 1676246635164) 2023-02-13 00:04:00,049 DEBUG [RS:1;jenkins-hbase4:36715] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/oldWALs 2023-02-13 00:04:00,049 INFO [RS:1;jenkins-hbase4:36715] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36715%2C1676246634643:(num 1676246635587) 2023-02-13 00:04:00,049 DEBUG [RS:1;jenkins-hbase4:36715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:00,050 INFO [RS:1;jenkins-hbase4:36715] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:00,050 INFO [RS:1;jenkins-hbase4:36715] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:00,050 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:00,051 INFO [RS:1;jenkins-hbase4:36715] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36715 2023-02-13 00:04:00,053 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42213,1676246634611 already deleted, retry=false 2023-02-13 00:04:00,053 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42213,1676246634611 expired; onlineServers=1 2023-02-13 00:04:00,129 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:00,129 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36715,1676246634643 2023-02-13 00:04:00,129 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@507c6d42 rejected from java.util.concurrent.ThreadPoolExecutor@5443e395[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,169 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36715,1676246634643] 2023-02-13 00:04:00,169 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36715,1676246634643; numProcessing=2 2023-02-13 00:04:00,192 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36715,1676246634643 already deleted, retry=false 2023-02-13 00:04:00,192 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36715,1676246634643 expired; onlineServers=0 2023-02-13 00:04:00,192 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46835,1676246634561' ***** 2023-02-13 00:04:00,192 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:04:00,193 DEBUG [M:0;jenkins-hbase4:46835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a53b421, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:00,193 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46835,1676246634561 2023-02-13 00:04:00,193 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46835,1676246634561; all regions closed. 2023-02-13 00:04:00,193 DEBUG [M:0;jenkins-hbase4:46835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:00,193 DEBUG [M:0;jenkins-hbase4:46835] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:04:00,194 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:04:00,194 DEBUG [M:0;jenkins-hbase4:46835] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:04:00,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246634805] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246634805,5,FailOnTimeoutGroup] 2023-02-13 00:04:00,194 INFO [M:0;jenkins-hbase4:46835] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:04:00,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246634804] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246634804,5,FailOnTimeoutGroup] 2023-02-13 00:04:00,195 INFO [M:0;jenkins-hbase4:46835] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:04:00,195 INFO [M:0;jenkins-hbase4:46835] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:04:00,195 DEBUG [M:0;jenkins-hbase4:46835] master.HMaster(1502): Stopping service threads 2023-02-13 00:04:00,195 INFO [M:0;jenkins-hbase4:46835] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:04:00,196 ERROR [M:0;jenkins-hbase4:46835] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 00:04:00,196 INFO [M:0;jenkins-hbase4:46835] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:04:00,196 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:04:00,261 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:00,261 DEBUG [M:0;jenkins-hbase4:46835] zookeeper.ZKUtil(398): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 00:04:00,261 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:00,261 WARN [M:0;jenkins-hbase4:46835] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 00:04:00,261 INFO [M:0;jenkins-hbase4:46835] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:04:00,262 INFO [M:0;jenkins-hbase4:46835] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:04:00,262 DEBUG [M:0;jenkins-hbase4:46835] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:00,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:00,262 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:00,262 DEBUG [M:0;jenkins-hbase4:46835] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:00,262 DEBUG [M:0;jenkins-hbase4:46835] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:00,262 DEBUG [M:0;jenkins-hbase4:46835] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:00,262 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.16 KB heapSize=200.04 KB 2023-02-13 00:04:00,274 INFO [M:0;jenkins-hbase4:46835] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.16 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f9489c188644d2c8d4d879dda20b1c4 2023-02-13 00:04:00,279 DEBUG [M:0;jenkins-hbase4:46835] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8f9489c188644d2c8d4d879dda20b1c4 as hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f9489c188644d2c8d4d879dda20b1c4 2023-02-13 00:04:00,283 INFO [M:0;jenkins-hbase4:46835] regionserver.HStore(1080): Added hdfs://localhost:36127/user/jenkins/test-data/7f4b59fd-876f-fcb6-caeb-174cc713c4c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8f9489c188644d2c8d4d879dda20b1c4, entries=53, sequenceid=357, filesize=10.7 K 2023-02-13 00:04:00,284 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegion(2947): Finished flush of dataSize ~167.16 KB/171173, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=357, compaction requested=false 2023-02-13 00:04:00,284 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:00,285 DEBUG [M:0;jenkins-hbase4:46835] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246640262Disabling compacts and flushes for region at 1676246640262Disabling writes for close at 1676246640262Obtaining lock to block concurrent updates at 1676246640262Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246640262Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171173, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676246640263 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246640264 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246640264Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246640267 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246640267Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246640279 (+12 ms)Finished flush of dataSize ~167.16 KB/171173, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=357, compaction requested=false at 1676246640284 (+5 ms)Writing region close event to WAL at 1676246640284Closed at 1676246640284 2023-02-13 00:04:00,287 INFO [M:0;jenkins-hbase4:46835] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:04:00,287 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:00,288 INFO [M:0;jenkins-hbase4:46835] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46835 2023-02-13 00:04:00,329 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:00,329 INFO [RS:1;jenkins-hbase4:36715] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36715,1676246634643; zookeeper connection closed. 2023-02-13 00:04:00,329 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13bf3914 rejected from java.util.concurrent.ThreadPoolExecutor@5443e395[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,329 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:36715-0x1004afdb9f20002, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:00,329 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b0e5081 rejected from java.util.concurrent.ThreadPoolExecutor@5443e395[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,329 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7b3c2094] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7b3c2094 2023-02-13 00:04:00,354 DEBUG [M:0;jenkins-hbase4:46835] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46835,1676246634561 already deleted, retry=false 2023-02-13 00:04:00,429 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:00,429 INFO [RS:0;jenkins-hbase4:42213] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42213,1676246634611; zookeeper connection closed. 2023-02-13 00:04:00,429 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66b76a0d rejected from java.util.concurrent.ThreadPoolExecutor@3a225509[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,429 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): regionserver:42213-0x1004afdb9f20001, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:00,430 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9d08d0d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9d08d0d 2023-02-13 00:04:00,430 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@415b26d9 rejected from java.util.concurrent.ThreadPoolExecutor@3a225509[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,430 INFO [Listener at localhost/42423] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:04:00,546 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:00,546 INFO [M:0;jenkins-hbase4:46835] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46835,1676246634561; zookeeper connection closed. 2023-02-13 00:04:00,546 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2daa0229 rejected from java.util.concurrent.ThreadPoolExecutor@29959344[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,547 DEBUG [Listener at localhost/42423-EventThread] zookeeper.ZKWatcher(600): master:46835-0x1004afdb9f20000, quorum=127.0.0.1:63953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:00,547 ERROR [Listener at localhost/42423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2077e1ec rejected from java.util.concurrent.ThreadPoolExecutor@29959344[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:00,547 WARN [Listener at localhost/42423] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:00,557 INFO [Listener at localhost/42423] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:00,665 WARN [BP-492076950-172.31.14.131-1676246633409 heartbeating to localhost/127.0.0.1:36127] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:00,665 WARN [BP-492076950-172.31.14.131-1676246633409 heartbeating to localhost/127.0.0.1:36127] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-492076950-172.31.14.131-1676246633409 (Datanode Uuid 9b94ff18-474e-460b-9717-e37ab6640e12) service to localhost/127.0.0.1:36127 2023-02-13 00:04:00,666 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/dfs/data/data3/current/BP-492076950-172.31.14.131-1676246633409] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:00,667 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/dfs/data/data4/current/BP-492076950-172.31.14.131-1676246633409] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:00,668 WARN [Listener at localhost/42423] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:00,672 INFO [Listener at localhost/42423] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:00,779 WARN [BP-492076950-172.31.14.131-1676246633409 heartbeating to localhost/127.0.0.1:36127] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:00,780 WARN [BP-492076950-172.31.14.131-1676246633409 heartbeating to localhost/127.0.0.1:36127] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-492076950-172.31.14.131-1676246633409 (Datanode Uuid fdbcb267-856f-411a-9674-e484e9ff4003) service to localhost/127.0.0.1:36127 2023-02-13 00:04:00,781 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/dfs/data/data1/current/BP-492076950-172.31.14.131-1676246633409] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:00,781 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/cluster_a3f2a2b2-3f7e-fa63-ddd7-cfc621f84555/dfs/data/data2/current/BP-492076950-172.31.14.131-1676246633409] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:00,792 INFO [Listener at localhost/42423] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:00,911 INFO [Listener at localhost/42423] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:04:00,947 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:04:00,961 INFO [Listener at localhost/42423] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=229 (was 177) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36127 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36127 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36127 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,46835,1676246634561)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:36127 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36127 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36127 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:36127 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42423.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=634 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3881 (was 3929) 2023-02-13 00:04:00,971 INFO [Listener at localhost/42423] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=229, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=168, AvailableMemoryMB=3880 2023-02-13 00:04:00,981 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/hadoop.log.dir so I do NOT create it in target/test-data/c61c29a4-f283-1511-f541-2d62712a649d 2023-02-13 00:04:00,981 WARN [Listener at localhost/42423] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 00:04:00,981 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/hadoop.tmp.dir so I do NOT create it in target/test-data/c61c29a4-f283-1511-f541-2d62712a649d 2023-02-13 00:04:00,981 WARN [Listener at localhost/42423] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd3d30a4-b647-f0fe-ae91-552d493a78d1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 00:04:00,981 DEBUG [Listener at localhost/42423] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d, deleteOnExit=true 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/test.cache.data in system properties and HBase conf 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:04:00,982 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:04:00,982 DEBUG [Listener at localhost/42423] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:04:00,983 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:04:00,984 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:04:00,984 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:04:00,984 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:04:00,984 INFO [Listener at localhost/42423] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:04:00,988 WARN [Listener at localhost/42423] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:04:00,988 WARN [Listener at localhost/42423] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:04:01,903 WARN [Listener at localhost/42423] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 00:04:01,972 WARN [Listener at localhost/42423] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:01,975 INFO [Listener at localhost/42423] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:01,981 INFO [Listener at localhost/42423] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/java.io.tmpdir/Jetty_localhost_46259_hdfs____.38716q/webapp 2023-02-13 00:04:02,073 INFO [Listener at localhost/42423] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46259 2023-02-13 00:04:02,077 WARN [Listener at localhost/42423] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:04:02,078 WARN [Listener at localhost/42423] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:04:02,380 WARN [Listener at localhost/36773] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:02,391 WARN [Listener at localhost/36773] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:04:02,393 WARN [Listener at localhost/36773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:02,394 INFO [Listener at localhost/36773] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:02,400 INFO [Listener at localhost/36773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/java.io.tmpdir/Jetty_localhost_40639_datanode____my3vgn/webapp 2023-02-13 00:04:02,497 INFO [Listener at localhost/36773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40639 2023-02-13 00:04:02,507 WARN [Listener at localhost/36567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:02,524 WARN [Listener at localhost/36567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:04:02,526 WARN [Listener at localhost/36567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:02,527 INFO [Listener at localhost/36567] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:02,531 INFO [Listener at localhost/36567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/java.io.tmpdir/Jetty_localhost_37265_datanode____.lvl3bg/webapp 2023-02-13 00:04:02,619 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x76d733d02bd6618d: Processing first storage report for DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e from datanode 1430fcd2-0a4e-4fdd-83cd-221372035849 2023-02-13 00:04:02,619 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x76d733d02bd6618d: from storage DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e node DatanodeRegistration(127.0.0.1:45571, datanodeUuid=1430fcd2-0a4e-4fdd-83cd-221372035849, infoPort=33899, infoSecurePort=0, ipcPort=36567, storageInfo=lv=-57;cid=testClusterID;nsid=1521798457;c=1676246640990), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:02,619 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x76d733d02bd6618d: Processing first storage report for DS-8f2580dd-8ffd-4af1-905b-87e686ddfc52 from datanode 1430fcd2-0a4e-4fdd-83cd-221372035849 2023-02-13 00:04:02,619 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x76d733d02bd6618d: from storage DS-8f2580dd-8ffd-4af1-905b-87e686ddfc52 node DatanodeRegistration(127.0.0.1:45571, datanodeUuid=1430fcd2-0a4e-4fdd-83cd-221372035849, infoPort=33899, infoSecurePort=0, ipcPort=36567, storageInfo=lv=-57;cid=testClusterID;nsid=1521798457;c=1676246640990), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:02,645 INFO [Listener at localhost/36567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37265 2023-02-13 00:04:02,653 WARN [Listener at localhost/46179] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:02,868 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x65dd3046872b1c89: Processing first storage report for DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39 from datanode 2081eea0-6fc4-445c-96db-c7e317a80602 2023-02-13 00:04:02,868 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x65dd3046872b1c89: from storage DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39 node DatanodeRegistration(127.0.0.1:45223, datanodeUuid=2081eea0-6fc4-445c-96db-c7e317a80602, infoPort=34943, infoSecurePort=0, ipcPort=46179, storageInfo=lv=-57;cid=testClusterID;nsid=1521798457;c=1676246640990), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:02,868 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x65dd3046872b1c89: Processing first storage report for DS-ac3981be-388d-46d4-b6fb-b08002fb552d from datanode 2081eea0-6fc4-445c-96db-c7e317a80602 2023-02-13 00:04:02,868 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x65dd3046872b1c89: from storage DS-ac3981be-388d-46d4-b6fb-b08002fb552d node DatanodeRegistration(127.0.0.1:45223, datanodeUuid=2081eea0-6fc4-445c-96db-c7e317a80602, infoPort=34943, infoSecurePort=0, ipcPort=46179, storageInfo=lv=-57;cid=testClusterID;nsid=1521798457;c=1676246640990), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:02,964 DEBUG [Listener at localhost/46179] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d 2023-02-13 00:04:02,966 INFO [Listener at localhost/46179] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/zookeeper_0, clientPort=58180, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:04:02,967 INFO [Listener at localhost/46179] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58180 2023-02-13 00:04:02,967 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:02,968 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:02,979 INFO [Listener at localhost/46179] util.FSUtils(479): Created version file at hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16 with version=8 2023-02-13 00:04:02,980 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:02,980 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:02,981 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/hbase-staging 2023-02-13 00:04:02,983 INFO [Listener at localhost/46179] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:02,983 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:02,983 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:02,983 INFO [Listener at localhost/46179] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:02,983 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:02,983 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:02,984 INFO [Listener at localhost/46179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:02,984 INFO [Listener at localhost/46179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33817 2023-02-13 00:04:02,984 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:02,985 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:02,986 INFO [Listener at localhost/46179] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33817 connecting to ZooKeeper ensemble=127.0.0.1:58180 2023-02-13 00:04:02,993 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:338170x0, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:02,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33817-0x1004afddada0000 connected 2023-02-13 00:04:03,009 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:03,010 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:03,010 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:03,012 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33817 2023-02-13 00:04:03,012 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33817 2023-02-13 00:04:03,012 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33817 2023-02-13 00:04:03,015 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33817 2023-02-13 00:04:03,016 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33817 2023-02-13 00:04:03,016 INFO [Listener at localhost/46179] master.HMaster(439): hbase.rootdir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16, hbase.cluster.distributed=false 2023-02-13 00:04:03,031 INFO [Listener at localhost/46179] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:03,032 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:03,032 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:03,032 INFO [Listener at localhost/46179] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:03,032 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:03,032 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:03,032 INFO [Listener at localhost/46179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:03,033 INFO [Listener at localhost/46179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32865 2023-02-13 00:04:03,033 INFO [Listener at localhost/46179] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:04:03,035 DEBUG [Listener at localhost/46179] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:03,036 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:03,037 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:03,038 INFO [Listener at localhost/46179] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32865 connecting to ZooKeeper ensemble=127.0.0.1:58180 2023-02-13 00:04:03,044 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:328650x0, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:03,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32865-0x1004afddada0001 connected 2023-02-13 00:04:03,045 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:03,046 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:03,046 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:03,048 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32865 2023-02-13 00:04:03,048 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32865 2023-02-13 00:04:03,048 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32865 2023-02-13 00:04:03,052 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32865 2023-02-13 00:04:03,052 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32865 2023-02-13 00:04:03,063 INFO [Listener at localhost/46179] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:03,063 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:03,063 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:03,063 INFO [Listener at localhost/46179] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:03,063 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:03,064 INFO [Listener at localhost/46179] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:03,064 INFO [Listener at localhost/46179] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:03,064 INFO [Listener at localhost/46179] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38753 2023-02-13 00:04:03,065 INFO [Listener at localhost/46179] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:04:03,066 DEBUG [Listener at localhost/46179] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:03,066 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:03,067 INFO [Listener at localhost/46179] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:03,068 INFO [Listener at localhost/46179] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38753 connecting to ZooKeeper ensemble=127.0.0.1:58180 2023-02-13 00:04:03,075 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:387530x0, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:03,076 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:387530x0, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:03,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38753-0x1004afddada0002 connected 2023-02-13 00:04:03,077 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:03,077 DEBUG [Listener at localhost/46179] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:03,080 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38753 2023-02-13 00:04:03,080 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38753 2023-02-13 00:04:03,080 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38753 2023-02-13 00:04:03,081 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38753 2023-02-13 00:04:03,081 DEBUG [Listener at localhost/46179] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38753 2023-02-13 00:04:03,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,084 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:04:03,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,086 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:03,086 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:03,086 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,086 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:03,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:04:03,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33817,1676246642983 from backup master directory 2023-02-13 00:04:03,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:04:03,091 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,091 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:03,091 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:04:03,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/hbase.id with ID: ce11e656-919a-4c77-92ea-d822a220d3df 2023-02-13 00:04:03,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:03,116 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x143efccb to 127.0.0.1:58180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:03,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bace4ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:03,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:03,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:04:03,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:03,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store-tmp 2023-02-13 00:04:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:03,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:03,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:03,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246643141Disabling compacts and flushes for region at 1676246643141Disabling writes for close at 1676246643141Writing region close event to WAL at 1676246643141Closed at 1676246643141 2023-02-13 00:04:03,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/WALs/jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33817%2C1676246642983, suffix=, logDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/WALs/jenkins-hbase4.apache.org,33817,1676246642983, archiveDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/oldWALs, maxLogs=10 2023-02-13 00:04:03,156 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK] 2023-02-13 00:04:03,156 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK] 2023-02-13 00:04:03,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/WALs/jenkins-hbase4.apache.org,33817,1676246642983/jenkins-hbase4.apache.org%2C33817%2C1676246642983.1676246643144 2023-02-13 00:04:03,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK], DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK]] 2023-02-13 00:04:03,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:03,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:03,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:03,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:03,160 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:03,161 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:04:03,161 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:04:03,162 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:03,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:03,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:03,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:03,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63446220, jitterRate=-0.054577648639678955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:04:03,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246643158Initializing all the Stores at 1676246643159 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246643159Cleaning up temporary data from old regions at 1676246643163 (+4 ms)Cleaning up detritus from prior splits at 1676246643163Region opened successfully at 1676246643169 (+6 ms) 2023-02-13 00:04:03,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:04:03,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:04:03,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:04:03,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:04:03,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 00:04:03,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 00:04:03,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:04:03,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:04:03,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:04:03,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:04:03,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:04:03,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:04:03,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:04:03,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:04:03,184 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:04:03,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:04:03,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:04:03,187 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:03,188 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:03,188 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,188 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:03,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33817,1676246642983, sessionid=0x1004afddada0000, setting cluster-up flag (Was=false) 2023-02-13 00:04:03,192 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:04:03,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,200 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:04:03,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:03,205 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.hbase-snapshot/.tmp 2023-02-13 00:04:03,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:03,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:03,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:03,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:03,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:03,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:04:03,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:03,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246673211 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:04:03,211 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,211 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:04:03,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:04:03,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:04:03,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:04:03,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:04:03,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:04:03,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246643212,5,FailOnTimeoutGroup] 2023-02-13 00:04:03,213 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:03,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246643213,5,FailOnTimeoutGroup] 2023-02-13 00:04:03,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:04:03,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,223 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:03,223 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:03,223 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16 2023-02-13 00:04:03,234 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:03,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:04:03,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/info 2023-02-13 00:04:03,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:04:03,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:04:03,238 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:03,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:04:03,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:04:03,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/table 2023-02-13 00:04:03,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:04:03,240 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,241 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740 2023-02-13 00:04:03,241 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740 2023-02-13 00:04:03,242 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:04:03,243 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:04:03,244 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:03,245 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61282118, jitterRate=-0.08682528138160706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:04:03,245 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246643234Initializing all the Stores at 1676246643235 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246643235Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246643235Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246643235Cleaning up temporary data from old regions at 1676246643241 (+6 ms)Cleaning up detritus from prior splits at 1676246643242 (+1 ms)Region opened successfully at 1676246643245 (+3 ms) 2023-02-13 00:04:03,245 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:04:03,245 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:04:03,245 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:04:03,245 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:04:03,245 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:04:03,245 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:03,245 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246643245Disabling compacts and flushes for region at 1676246643245Disabling writes for close at 1676246643245Writing region close event to WAL at 1676246643245Closed at 1676246643245 2023-02-13 00:04:03,246 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:03,246 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:04:03,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:04:03,247 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:04:03,248 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:04:03,283 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(952): ClusterId : ce11e656-919a-4c77-92ea-d822a220d3df 2023-02-13 00:04:03,283 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(952): ClusterId : ce11e656-919a-4c77-92ea-d822a220d3df 2023-02-13 00:04:03,283 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:04:03,283 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:04:03,285 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:04:03,285 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:04:03,285 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:04:03,285 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:04:03,288 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:04:03,289 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:04:03,289 DEBUG [RS:0;jenkins-hbase4:32865] zookeeper.ReadOnlyZKClient(139): Connect 0x010d1ce4 to 127.0.0.1:58180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:03,291 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ReadOnlyZKClient(139): Connect 0x52765525 to 127.0.0.1:58180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:03,298 DEBUG [RS:0;jenkins-hbase4:32865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fcaf2b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:03,298 DEBUG [RS:0;jenkins-hbase4:32865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bf57794, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:03,298 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cb1b11b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:03,298 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588e3e55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:03,307 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32865 2023-02-13 00:04:03,307 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38753 2023-02-13 00:04:03,307 INFO [RS:0;jenkins-hbase4:32865] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:04:03,307 INFO [RS:0;jenkins-hbase4:32865] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:04:03,307 INFO [RS:1;jenkins-hbase4:38753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:04:03,307 INFO [RS:1;jenkins-hbase4:38753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:04:03,307 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:04:03,307 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:04:03,307 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33817,1676246642983 with isa=jenkins-hbase4.apache.org/172.31.14.131:32865, startcode=1676246643031 2023-02-13 00:04:03,307 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33817,1676246642983 with isa=jenkins-hbase4.apache.org/172.31.14.131:38753, startcode=1676246643063 2023-02-13 00:04:03,308 DEBUG [RS:0;jenkins-hbase4:32865] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:04:03,308 DEBUG [RS:1;jenkins-hbase4:38753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:04:03,309 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53021, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:04:03,309 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59581, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:04:03,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33817] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,311 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,312 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16 2023-02-13 00:04:03,312 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16 2023-02-13 00:04:03,312 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36773 2023-02-13 00:04:03,312 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36773 2023-02-13 00:04:03,312 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:04:03,312 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:04:03,318 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:03,318 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ZKUtil(162): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,319 DEBUG [RS:0;jenkins-hbase4:32865] zookeeper.ZKUtil(162): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,319 WARN [RS:1;jenkins-hbase4:38753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:03,319 WARN [RS:0;jenkins-hbase4:32865] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:03,319 INFO [RS:1;jenkins-hbase4:38753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:03,319 INFO [RS:0;jenkins-hbase4:32865] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:03,319 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,319 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,319 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38753,1676246643063] 2023-02-13 00:04:03,319 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32865,1676246643031] 2023-02-13 00:04:03,325 DEBUG [RS:0;jenkins-hbase4:32865] zookeeper.ZKUtil(162): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,325 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ZKUtil(162): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,325 DEBUG [RS:0;jenkins-hbase4:32865] zookeeper.ZKUtil(162): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,326 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ZKUtil(162): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,326 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:04:03,326 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:04:03,326 INFO [RS:0;jenkins-hbase4:32865] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:04:03,326 INFO [RS:1;jenkins-hbase4:38753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:04:03,327 INFO [RS:0;jenkins-hbase4:32865] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:04:03,328 INFO [RS:0;jenkins-hbase4:32865] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:04:03,328 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,328 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:04:03,329 INFO [RS:1;jenkins-hbase4:38753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:04:03,329 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,329 INFO [RS:1;jenkins-hbase4:38753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 DEBUG [RS:0;jenkins-hbase4:32865] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,330 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:04:03,332 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,332 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,332 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,335 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,335 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:03,340 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,340 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,340 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,349 INFO [RS:0;jenkins-hbase4:32865] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:04:03,349 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32865,1676246643031-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,350 INFO [RS:1;jenkins-hbase4:38753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:04:03,350 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38753,1676246643063-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,359 INFO [RS:0;jenkins-hbase4:32865] regionserver.Replication(203): jenkins-hbase4.apache.org,32865,1676246643031 started 2023-02-13 00:04:03,359 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32865,1676246643031, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32865, sessionid=0x1004afddada0001 2023-02-13 00:04:03,359 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:04:03,359 DEBUG [RS:0;jenkins-hbase4:32865] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,359 DEBUG [RS:0;jenkins-hbase4:32865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32865,1676246643031' 2023-02-13 00:04:03,359 DEBUG [RS:0;jenkins-hbase4:32865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32865,1676246643031' 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:03,360 DEBUG [RS:0;jenkins-hbase4:32865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:03,361 DEBUG [RS:0;jenkins-hbase4:32865] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:04:03,361 INFO [RS:0;jenkins-hbase4:32865] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:04:03,361 INFO [RS:0;jenkins-hbase4:32865] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:04:03,365 INFO [RS:1;jenkins-hbase4:38753] regionserver.Replication(203): jenkins-hbase4.apache.org,38753,1676246643063 started 2023-02-13 00:04:03,365 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38753,1676246643063, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38753, sessionid=0x1004afddada0002 2023-02-13 00:04:03,365 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:04:03,365 DEBUG [RS:1;jenkins-hbase4:38753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,365 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38753,1676246643063' 2023-02-13 00:04:03,365 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:03,365 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38753,1676246643063' 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:03,366 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:04:03,366 INFO [RS:1;jenkins-hbase4:38753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:04:03,366 INFO [RS:1;jenkins-hbase4:38753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:04:03,399 DEBUG [jenkins-hbase4:33817] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:04:03,399 DEBUG [jenkins-hbase4:33817] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:03,400 DEBUG [jenkins-hbase4:33817] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:03,400 DEBUG [jenkins-hbase4:33817] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:03,400 DEBUG [jenkins-hbase4:33817] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:03,400 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32865,1676246643031, state=OPENING 2023-02-13 00:04:03,401 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:04:03,403 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:03,403 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:04:03,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32865,1676246643031}] 2023-02-13 00:04:03,559 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:03,559 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:04:03,561 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:04:03,565 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:04:03,565 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:03,566 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32865%2C1676246643031.meta, suffix=.meta, logDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,32865,1676246643031, archiveDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/oldWALs, maxLogs=32 2023-02-13 00:04:03,578 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK] 2023-02-13 00:04:03,579 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK] 2023-02-13 00:04:03,580 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,32865,1676246643031/jenkins-hbase4.apache.org%2C32865%2C1676246643031.meta.1676246643566.meta 2023-02-13 00:04:03,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK], DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK]] 2023-02-13 00:04:03,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:03,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:04:03,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:04:03,581 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:04:03,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:04:03,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:03,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:04:03,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:04:03,583 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:04:03,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/info 2023-02-13 00:04:03,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/info 2023-02-13 00:04:03,584 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:04:03,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:04:03,585 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:03,585 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:03,585 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:04:03,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:04:03,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/table 2023-02-13 00:04:03,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/table 2023-02-13 00:04:03,586 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:04:03,587 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740 2023-02-13 00:04:03,588 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740 2023-02-13 00:04:03,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:04:03,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:04:03,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72323215, jitterRate=0.07769988477230072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:04:03,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246643581Writing region info on filesystem at 1676246643581Initializing all the Stores at 1676246643582 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246643582Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246643582Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246643582Cleaning up temporary data from old regions at 1676246643589 (+7 ms)Cleaning up detritus from prior splits at 1676246643589Running coprocessor post-open hooks at 1676246643591 (+2 ms)Region opened successfully at 1676246643591 2023-02-13 00:04:03,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246643559 2023-02-13 00:04:03,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:04:03,595 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:04:03,596 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32865,1676246643031, state=OPEN 2023-02-13 00:04:03,597 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:04:03,597 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:04:03,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:04:03,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32865,1676246643031 in 194 msec 2023-02-13 00:04:03,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:04:03,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-13 00:04:03,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 394 msec 2023-02-13 00:04:03,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246643085, completionTime=-1 2023-02-13 00:04:03,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:04:03,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:04:03,603 DEBUG [hconnection-0x61b52336-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:03,605 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:03,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:04:03,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246703606 2023-02-13 00:04:03,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246763606 2023-02-13 00:04:03,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33817,1676246642983-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33817,1676246642983-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33817,1676246642983-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33817, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:04:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:03,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:04:03,615 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:04:03,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:04:03,616 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:04:03,617 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,617 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df empty. 2023-02-13 00:04:03,617 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,617 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:04:03,625 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:03,626 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => eb8ce3fc23163070581fa6fd78a286df, NAME => 'hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp 2023-02-13 00:04:03,631 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:03,631 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing eb8ce3fc23163070581fa6fd78a286df, disabling compactions & flushes 2023-02-13 00:04:03,631 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,631 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,631 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. after waiting 0 ms 2023-02-13 00:04:03,631 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,631 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,631 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for eb8ce3fc23163070581fa6fd78a286df: Waiting for close lock at 1676246643631Disabling compacts and flushes for region at 1676246643631Disabling writes for close at 1676246643631Writing region close event to WAL at 1676246643631Closed at 1676246643631 2023-02-13 00:04:03,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:04:03,634 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246643634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246643634"}]},"ts":"1676246643634"} 2023-02-13 00:04:03,636 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:04:03,637 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:04:03,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246643637"}]},"ts":"1676246643637"} 2023-02-13 00:04:03,638 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:04:03,640 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:03,641 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:03,641 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:03,641 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:03,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=eb8ce3fc23163070581fa6fd78a286df, ASSIGN}] 2023-02-13 00:04:03,643 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=eb8ce3fc23163070581fa6fd78a286df, ASSIGN 2023-02-13 00:04:03,644 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=eb8ce3fc23163070581fa6fd78a286df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38753,1676246643063; forceNewPlan=false, retain=false 2023-02-13 00:04:03,794 INFO [jenkins-hbase4:33817] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:04:03,794 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=eb8ce3fc23163070581fa6fd78a286df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,794 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246643794"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246643794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246643794"}]},"ts":"1676246643794"} 2023-02-13 00:04:03,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure eb8ce3fc23163070581fa6fd78a286df, server=jenkins-hbase4.apache.org,38753,1676246643063}] 2023-02-13 00:04:03,948 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,949 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:04:03,950 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:04:03,954 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,955 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38753%2C1676246643063, suffix=, logDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,38753,1676246643063, archiveDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/oldWALs, maxLogs=32 2023-02-13 00:04:03,968 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK] 2023-02-13 00:04:03,968 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK] 2023-02-13 00:04:03,969 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,38753,1676246643063/jenkins-hbase4.apache.org%2C38753%2C1676246643063.1676246643955 2023-02-13 00:04:03,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK], DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK]] 2023-02-13 00:04:03,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eb8ce3fc23163070581fa6fd78a286df, NAME => 'hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:03,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:03,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,971 INFO [StoreOpener-eb8ce3fc23163070581fa6fd78a286df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,972 DEBUG [StoreOpener-eb8ce3fc23163070581fa6fd78a286df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/info 2023-02-13 00:04:03,972 DEBUG [StoreOpener-eb8ce3fc23163070581fa6fd78a286df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/info 2023-02-13 00:04:03,972 INFO [StoreOpener-eb8ce3fc23163070581fa6fd78a286df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb8ce3fc23163070581fa6fd78a286df columnFamilyName info 2023-02-13 00:04:03,973 INFO [StoreOpener-eb8ce3fc23163070581fa6fd78a286df-1] regionserver.HStore(310): Store=eb8ce3fc23163070581fa6fd78a286df/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:03,973 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,974 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,975 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:03,977 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:03,977 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eb8ce3fc23163070581fa6fd78a286df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68138933, jitterRate=0.015349224209785461}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:04:03,977 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eb8ce3fc23163070581fa6fd78a286df: Running coprocessor pre-open hook at 1676246643970Writing region info on filesystem at 1676246643970Initializing all the Stores at 1676246643971 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246643971Cleaning up temporary data from old regions at 1676246643974 (+3 ms)Cleaning up detritus from prior splits at 1676246643974Running coprocessor post-open hooks at 1676246643977 (+3 ms)Region opened successfully at 1676246643977 2023-02-13 00:04:03,978 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df., pid=6, masterSystemTime=1676246643948 2023-02-13 00:04:03,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,982 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:03,982 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=eb8ce3fc23163070581fa6fd78a286df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:03,982 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246643982"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246643982"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246643982"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246643982"}]},"ts":"1676246643982"} 2023-02-13 00:04:03,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:04:03,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure eb8ce3fc23163070581fa6fd78a286df, server=jenkins-hbase4.apache.org,38753,1676246643063 in 187 msec 2023-02-13 00:04:03,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:04:03,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=eb8ce3fc23163070581fa6fd78a286df, ASSIGN in 343 msec 2023-02-13 00:04:03,986 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:04:03,986 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246643986"}]},"ts":"1676246643986"} 2023-02-13 00:04:03,987 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:04:03,990 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:04:03,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 377 msec 2023-02-13 00:04:04,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:04:04,016 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:04,016 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:04,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:04,019 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49786, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:04,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:04:04,029 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:04,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 00:04:04,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:04:04,041 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:04,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-13 00:04:04,056 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:04:04,059 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:04:04,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.968sec 2023-02-13 00:04:04,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:04:04,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:04:04,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:04:04,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33817,1676246642983-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:04:04,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33817,1676246642983-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:04:04,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:04:04,083 DEBUG [Listener at localhost/46179] zookeeper.ReadOnlyZKClient(139): Connect 0x37ec8611 to 127.0.0.1:58180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:04,093 DEBUG [Listener at localhost/46179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f2e3050, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:04,095 DEBUG [hconnection-0x2ceca219-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:04,096 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43546, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:04,098 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:04,098 DEBUG [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:04:04,103 DEBUG [Listener at localhost/46179] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:04:04,105 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51750, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:04:04,106 INFO [Listener at localhost/46179] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:04:04,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:51750 deadline: 1676246704106, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,107 INFO [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-13 00:04:04,109 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:04,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:04:04,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-13 00:04:04,112 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:04:04,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:04,113 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,113 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e empty. 2023-02-13 00:04:04,114 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,114 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 00:04:04,121 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:04,122 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0d2b8388e7ba9f4b6646204d926ba59e, NAME => 'testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp 2023-02-13 00:04:04,128 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:04,128 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 0d2b8388e7ba9f4b6646204d926ba59e, disabling compactions & flushes 2023-02-13 00:04:04,128 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,128 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,128 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. after waiting 0 ms 2023-02-13 00:04:04,128 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,128 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,128 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 0d2b8388e7ba9f4b6646204d926ba59e: Waiting for close lock at 1676246644128Disabling compacts and flushes for region at 1676246644128Disabling writes for close at 1676246644128Writing region close event to WAL at 1676246644128Closed at 1676246644128 2023-02-13 00:04:04,130 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:04:04,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676246644130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246644130"}]},"ts":"1676246644130"} 2023-02-13 00:04:04,131 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:04:04,132 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:04:04,132 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246644132"}]},"ts":"1676246644132"} 2023-02-13 00:04:04,133 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-13 00:04:04,136 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:04,137 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:04,137 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:04,137 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:04,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, ASSIGN}] 2023-02-13 00:04:04,139 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, ASSIGN 2023-02-13 00:04:04,140 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38753,1676246643063; forceNewPlan=false, retain=false 2023-02-13 00:04:04,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:04,290 INFO [jenkins-hbase4:33817] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:04:04,290 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0d2b8388e7ba9f4b6646204d926ba59e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,291 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676246644290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246644290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246644290"}]},"ts":"1676246644290"} 2023-02-13 00:04:04,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 0d2b8388e7ba9f4b6646204d926ba59e, server=jenkins-hbase4.apache.org,38753,1676246643063}] 2023-02-13 00:04:04,362 INFO [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32865%2C1676246643031, suffix=, logDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,32865,1676246643031, archiveDir=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/oldWALs, maxLogs=32 2023-02-13 00:04:04,374 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK] 2023-02-13 00:04:04,374 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK] 2023-02-13 00:04:04,376 INFO [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/WALs/jenkins-hbase4.apache.org,32865,1676246643031/jenkins-hbase4.apache.org%2C32865%2C1676246643031.1676246644362 2023-02-13 00:04:04,376 DEBUG [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45223,DS-e13904da-d26a-47bf-83a0-a3d0a3ea6b39,DISK], DatanodeInfoWithStorage[127.0.0.1:45571,DS-0c94dd8e-efdc-4460-a6c1-f681bf21b45e,DISK]] 2023-02-13 00:04:04,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:04,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d2b8388e7ba9f4b6646204d926ba59e, NAME => 'testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,448 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,449 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1 2023-02-13 00:04:04,449 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1 2023-02-13 00:04:04,449 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d2b8388e7ba9f4b6646204d926ba59e columnFamilyName f1 2023-02-13 00:04:04,450 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(310): Store=0d2b8388e7ba9f4b6646204d926ba59e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:04,450 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,451 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2 2023-02-13 00:04:04,451 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2 2023-02-13 00:04:04,451 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d2b8388e7ba9f4b6646204d926ba59e columnFamilyName f2 2023-02-13 00:04:04,451 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(310): Store=0d2b8388e7ba9f4b6646204d926ba59e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:04,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:04:04,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:04,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:04,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d2b8388e7ba9f4b6646204d926ba59e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69414637, jitterRate=0.03435869514942169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:04:04,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d2b8388e7ba9f4b6646204d926ba59e: Running coprocessor pre-open hook at 1676246644447Writing region info on filesystem at 1676246644447Initializing all the Stores at 1676246644448 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246644448Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246644448Cleaning up temporary data from old regions at 1676246644453 (+5 ms)Cleaning up detritus from prior splits at 1676246644453Running coprocessor post-open hooks at 1676246644456 (+3 ms)Region opened successfully at 1676246644456 2023-02-13 00:04:04,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e., pid=12, masterSystemTime=1676246644444 2023-02-13 00:04:04,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0d2b8388e7ba9f4b6646204d926ba59e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676246644458"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246644458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246644458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246644458"}]},"ts":"1676246644458"} 2023-02-13 00:04:04,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 00:04:04,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 0d2b8388e7ba9f4b6646204d926ba59e, server=jenkins-hbase4.apache.org,38753,1676246643063 in 167 msec 2023-02-13 00:04:04,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 00:04:04,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, ASSIGN in 323 msec 2023-02-13 00:04:04,462 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:04:04,462 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246644462"}]},"ts":"1676246644462"} 2023-02-13 00:04:04,463 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-13 00:04:04,465 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:04:04,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 356 msec 2023-02-13 00:04:04,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:04,716 INFO [Listener at localhost/46179] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-13 00:04:04,716 DEBUG [Listener at localhost/46179] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-13 00:04:04,717 INFO [Listener at localhost/46179] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:04:04,720 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-13 00:04:04,721 INFO [Listener at localhost/46179] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:04:04,721 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-13 00:04:04,721 INFO [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:04:04,732 DEBUG [hconnection-0x2ceca219-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:04,745 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:04,752 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,834 INFO [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:04:04,834 INFO [Listener at localhost/46179] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:04:04,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 00:04:04,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246644835 (current time:1676246644835). 2023-02-13 00:04:04,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:04:04,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] zookeeper.ReadOnlyZKClient(139): Connect 0x0087f94d to 127.0.0.1:58180 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:04,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22770e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:04,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:04,841 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:04,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0087f94d to 127.0.0.1:58180 2023-02-13 00:04:04,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:04,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:04:04,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 00:04:04,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 00:04:04,845 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 00:04:04,846 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676247244846 2023-02-13 00:04:04,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 00:04:04,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,847 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:04:04,847 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:04:04,848 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 00:04:04,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 00:04:04,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-13 00:04:04,850 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 00:04:04,850 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676247244850 2023-02-13 00:04:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,857 INFO [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 00:04:04,857 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:04,858 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 00:04:04,858 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 00:04:04,859 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,859 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,861 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:04,861 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:04,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:04,861 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:04,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:04,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:04,861 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,861 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:04:04,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,862 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 00:04:04,862 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:04,863 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 00:04:04,863 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 00:04:04,863 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 00:04:04,863 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:04,863 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32865,1676246643031' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 00:04:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 00:04:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 00:04:04,864 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38753,1676246643063' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 00:04:04,865 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,866 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,866 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:04,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:04,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38753,1676246643063' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 00:04:04,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49a59073[Count = 0] remaining members to acquire global barrier 2023-02-13 00:04:04,868 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 00:04:04,868 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,869 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:04:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 00:04:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 00:04:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32865,1676246643031' in zk 2023-02-13 00:04:04,869 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 00:04:04,870 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 00:04:04,870 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:04:04,870 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,870 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. started... 2023-02-13 00:04:04,870 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0d2b8388e7ba9f4b6646204d926ba59e 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 00:04:04,872 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 00:04:04,872 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:04,872 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 00:04:04,883 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f1/e10504954122439481553b7b781c91f2 2023-02-13 00:04:04,899 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f2/af643f11269743229a5427730d2bac24 2023-02-13 00:04:04,903 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f1/e10504954122439481553b7b781c91f2 as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/e10504954122439481553b7b781c91f2 2023-02-13 00:04:04,907 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/e10504954122439481553b7b781c91f2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:04:04,907 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f2/af643f11269743229a5427730d2bac24 as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/af643f11269743229a5427730d2bac24 2023-02-13 00:04:04,911 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/af643f11269743229a5427730d2bac24, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:04:04,911 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 0d2b8388e7ba9f4b6646204d926ba59e in 41ms, sequenceid=5, compaction requested=false 2023-02-13 00:04:04,911 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0d2b8388e7ba9f4b6646204d926ba59e: 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/e10504954122439481553b7b781c91f2] hfiles 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/e10504954122439481553b7b781c91f2 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/af643f11269743229a5427730d2bac24] hfiles 2023-02-13 00:04:04,912 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/af643f11269743229a5427730d2bac24 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,920 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. completed. 2023-02-13 00:04:04,920 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:04,920 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 00:04:04,920 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 00:04:04,920 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,920 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 00:04:04,920 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38753,1676246643063' in zk 2023-02-13 00:04:04,922 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 00:04:04,922 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,922 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:04,922 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 00:04:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38753,1676246643063': 2023-02-13 00:04:04,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38753,1676246643063' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 00:04:04,925 INFO [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 00:04:04,925 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:04:04,925 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:04:04,925 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,925 INFO [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:04:04,926 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,926 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:04,927 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:04,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:04,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:04,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:04,928 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,929 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:04,929 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:04,936 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:04,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:04,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:04,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,936 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:04,937 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,937 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:04,937 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,937 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:04,937 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,937 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:04,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:04,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,947 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 00:04:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:04:04,949 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:04:04,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-13 00:04:04,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,971 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:04,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676246644846Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676246644937 (+91 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676246644937Writing data manifest for testWithMockedMapReduceSingleRegion at 1676246644939 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676246644946 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676246644970 (+24 ms) 2023-02-13 00:04:04,972 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 00:04:04,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 125 msec 2023-02-13 00:04:05,149 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:05,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 00:04:05,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:04:05,151 INFO [Listener at localhost/46179] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:04:05,154 INFO [Listener at localhost/46179] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:04:05,159 INFO [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:04:05,185 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,268 INFO [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:04:05,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:04:05,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,275 INFO [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 00:04:05,275 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:05,276 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 00:04:05,276 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 00:04:05,276 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,276 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,277 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:05,277 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,278 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:05,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:05,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:05,278 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,278 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:04:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,279 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 00:04:05,279 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:05,279 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 00:04:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 00:04:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:05,285 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 00:04:05,285 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 00:04:05,285 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,285 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. started... 2023-02-13 00:04:05,285 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:04:05,285 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 00:04:05,286 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32865,1676246643031' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 00:04:05,286 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d2b8388e7ba9f4b6646204d926ba59e 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 00:04:05,287 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,287 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,287 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:05,307 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f1/dcdf56f7e2a743329b0c0bab25520433 2023-02-13 00:04:05,327 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f2/29e0de4d21a64f499801da174bfce68e 2023-02-13 00:04:05,332 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f1/dcdf56f7e2a743329b0c0bab25520433 as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/dcdf56f7e2a743329b0c0bab25520433 2023-02-13 00:04:05,336 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/dcdf56f7e2a743329b0c0bab25520433, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:04:05,337 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/.tmp/f2/29e0de4d21a64f499801da174bfce68e as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/29e0de4d21a64f499801da174bfce68e 2023-02-13 00:04:05,348 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/29e0de4d21a64f499801da174bfce68e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:04:05,349 INFO [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 0d2b8388e7ba9f4b6646204d926ba59e in 63ms, sequenceid=9, compaction requested=false 2023-02-13 00:04:05,350 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d2b8388e7ba9f4b6646204d926ba59e: 2023-02-13 00:04:05,350 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676246643063)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,350 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 00:04:05,350 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 00:04:05,350 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,350 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 00:04:05,351 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38753,1676246643063' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 00:04:05,352 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,352 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:05,353 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,353 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:05,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38753,1676246643063' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 00:04:05,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d9a0d9f[Count = 0] remaining members to acquire global barrier 2023-02-13 00:04:05,355 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 00:04:05,355 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 00:04:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,357 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 00:04:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 00:04:05,357 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:04:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 00:04:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38753,1676246643063' in zk 2023-02-13 00:04:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32865,1676246643031' in zk 2023-02-13 00:04:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 00:04:05,359 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676246643063' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 00:04:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 00:04:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,32865,1676246643031' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 00:04:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38753,1676246643063': 2023-02-13 00:04:05,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38753,1676246643063' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 00:04:05,363 INFO [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 00:04:05,363 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:04:05,363 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:04:05,363 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,363 INFO [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:04:05,364 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,364 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,364 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,365 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:05,365 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:05,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:05,366 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,366 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,368 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,369 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:05,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-13 00:04:05,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,373 DEBUG [(jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:05,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:05,373 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:05,374 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-13 00:04:05,374 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:04:05,374 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,374 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,374 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:05,374 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,474 DEBUG [Listener at localhost/46179] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:04:05,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:04:05,480 INFO [Listener at localhost/46179] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676246644835 type: FLUSH version: 2 ttl: 0 2023-02-13 00:04:05,480 DEBUG [Listener at localhost/46179] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1/data/default/testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,480 INFO [Listener at localhost/46179] snapshot.RestoreSnapshotHelper(239): region to add: 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,480 INFO [Listener at localhost/46179] snapshot.RestoreSnapshotHelper(585): clone region=0d2b8388e7ba9f4b6646204d926ba59e as 0d2b8388e7ba9f4b6646204d926ba59e in snapshot testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,481 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0d2b8388e7ba9f4b6646204d926ba59e, NAME => 'testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1 2023-02-13 00:04:05,491 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:05,492 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e10504954122439481553b7b781c91f2 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,494 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af643f11269743229a5427730d2bac24 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,496 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0d2b8388e7ba9f4b6646204d926ba59e, disabling compactions & flushes 2023-02-13 00:04:05,496 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,496 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,496 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. after waiting 0 ms 2023-02-13 00:04:05,496 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,496 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,496 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0d2b8388e7ba9f4b6646204d926ba59e: Waiting for close lock at 1676246645496Disabling compacts and flushes for region at 1676246645496Disabling writes for close at 1676246645496Writing region close event to WAL at 1676246645496Closed at 1676246645496 2023-02-13 00:04:05,497 INFO [Listener at localhost/46179] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676246644835 type: FLUSH version: 2 ttl: 0 2023-02-13 00:04:05,497 DEBUG [Listener at localhost/46179] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1 2023-02-13 00:04:05,497 DEBUG [Listener at localhost/46179] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1 2023-02-13 00:04:05,497 DEBUG [Listener at localhost/46179] util.CommonFSUtils(699): |-data/ 2023-02-13 00:04:05,498 DEBUG [Listener at localhost/46179] util.CommonFSUtils(699): |----default/ 2023-02-13 00:04:05,498 DEBUG [Listener at localhost/46179] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-13 00:04:05,499 DEBUG [Listener at localhost/46179] util.CommonFSUtils(699): |----------0d2b8388e7ba9f4b6646204d926ba59e/ 2023-02-13 00:04:05,499 DEBUG [Listener at localhost/46179] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:04:05,499 DEBUG [Listener at localhost/46179] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:04:05,500 DEBUG [Listener at localhost/46179] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=0d2b8388e7ba9f4b6646204d926ba59e-e10504954122439481553b7b781c91f2 2023-02-13 00:04:05,500 DEBUG [Listener at localhost/46179] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:04:05,500 DEBUG [Listener at localhost/46179] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=0d2b8388e7ba9f4b6646204d926ba59e-af643f11269743229a5427730d2bac24 2023-02-13 00:04:05,503 INFO [Listener at localhost/46179] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 00:04:05,507 DEBUG [Listener at localhost/46179] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:05,507 INFO [Listener at localhost/46179] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:04:05,507 DEBUG [Listener at localhost/46179] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:05,509 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,510 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1 2023-02-13 00:04:05,511 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d2b8388e7ba9f4b6646204d926ba59e columnFamilyName f1 2023-02-13 00:04:05,514 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(539): loaded hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/testWithMockedMapReduceSingleRegion=0d2b8388e7ba9f4b6646204d926ba59e-e10504954122439481553b7b781c91f2 2023-02-13 00:04:05,514 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(310): Store=0d2b8388e7ba9f4b6646204d926ba59e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:05,514 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,515 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2 2023-02-13 00:04:05,515 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d2b8388e7ba9f4b6646204d926ba59e columnFamilyName f2 2023-02-13 00:04:05,519 DEBUG [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(539): loaded hdfs://localhost:36773/user/jenkins/test-data/e43e1a41-005e-fe79-be62-922d749cadfc/testWithMockedMapReduceSingleRegion/b2476e53-4863-42f9-995c-5277ca02dfe1/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/testWithMockedMapReduceSingleRegion=0d2b8388e7ba9f4b6646204d926ba59e-af643f11269743229a5427730d2bac24 2023-02-13 00:04:05,519 INFO [StoreOpener-0d2b8388e7ba9f4b6646204d926ba59e-1] regionserver.HStore(310): Store=0d2b8388e7ba9f4b6646204d926ba59e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:05,519 DEBUG [Listener at localhost/46179] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:04:05,519 INFO [Listener at localhost/46179] regionserver.HRegion(1071): Opened 0d2b8388e7ba9f4b6646204d926ba59e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61865033, jitterRate=-0.07813917100429535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:04:05,519 DEBUG [Listener at localhost/46179] regionserver.HRegion(964): Region open journal for 0d2b8388e7ba9f4b6646204d926ba59e: Writing region info on filesystem at 1676246645508Initializing all the Stores at 1676246645508Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246645508Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246645508Region opened successfully at 1676246645519 (+11 ms) 2023-02-13 00:04:05,568 DEBUG [Listener at localhost/46179] regionserver.HRegion(1603): Closing 0d2b8388e7ba9f4b6646204d926ba59e, disabling compactions & flushes 2023-02-13 00:04:05,568 INFO [Listener at localhost/46179] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,568 DEBUG [Listener at localhost/46179] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,568 DEBUG [Listener at localhost/46179] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. after waiting 0 ms 2023-02-13 00:04:05,569 DEBUG [Listener at localhost/46179] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,570 INFO [Listener at localhost/46179] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,570 DEBUG [Listener at localhost/46179] regionserver.HRegion(1557): Region close journal for 0d2b8388e7ba9f4b6646204d926ba59e: Waiting for close lock at 1676246645568Disabling compacts and flushes for region at 1676246645568Disabling writes for close at 1676246645569 (+1 ms)Writing region close event to WAL at 1676246645570 (+1 ms)Closed at 1676246645570 2023-02-13 00:04:05,574 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-13 00:04:05,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,577 INFO [Listener at localhost/46179] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:05,580 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246645580"}]},"ts":"1676246645580"} 2023-02-13 00:04:05,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-13 00:04:05,583 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-13 00:04:05,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, UNASSIGN}] 2023-02-13 00:04:05,584 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, UNASSIGN 2023-02-13 00:04:05,585 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0d2b8388e7ba9f4b6646204d926ba59e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,585 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676246645585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246645585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246645585"}]},"ts":"1676246645585"} 2023-02-13 00:04:05,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 0d2b8388e7ba9f4b6646204d926ba59e, server=jenkins-hbase4.apache.org,38753,1676246643063}] 2023-02-13 00:04:05,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:05,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d2b8388e7ba9f4b6646204d926ba59e, disabling compactions & flushes 2023-02-13 00:04:05,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. after waiting 0 ms 2023-02-13 00:04:05,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:04:05,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e. 2023-02-13 00:04:05,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d2b8388e7ba9f4b6646204d926ba59e: Waiting for close lock at 1676246645738Running coprocessor pre-close hooks at 1676246645738Disabling compacts and flushes for region at 1676246645738Disabling writes for close at 1676246645738Writing region close event to WAL at 1676246645739 (+1 ms)Running coprocessor post-close hooks at 1676246645742 (+3 ms)Closed at 1676246645742 2023-02-13 00:04:05,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,744 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0d2b8388e7ba9f4b6646204d926ba59e, regionState=CLOSED 2023-02-13 00:04:05,744 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676246645744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246645744"}]},"ts":"1676246645744"} 2023-02-13 00:04:05,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 00:04:05,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 0d2b8388e7ba9f4b6646204d926ba59e, server=jenkins-hbase4.apache.org,38753,1676246643063 in 159 msec 2023-02-13 00:04:05,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 00:04:05,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=0d2b8388e7ba9f4b6646204d926ba59e, UNASSIGN in 163 msec 2023-02-13 00:04:05,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246645748"}]},"ts":"1676246645748"} 2023-02-13 00:04:05,749 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-13 00:04:05,750 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-13 00:04:05,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-13 00:04:05,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:05,883 INFO [Listener at localhost/46179] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-13 00:04:05,883 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,885 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,886 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:04:05,888 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,890 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1, FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2, FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/recovered.edits] 2023-02-13 00:04:05,893 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/dcdf56f7e2a743329b0c0bab25520433 to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/archive/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/dcdf56f7e2a743329b0c0bab25520433 2023-02-13 00:04:05,894 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/e10504954122439481553b7b781c91f2 to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/archive/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f1/e10504954122439481553b7b781c91f2 2023-02-13 00:04:05,896 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/29e0de4d21a64f499801da174bfce68e to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/archive/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/29e0de4d21a64f499801da174bfce68e 2023-02-13 00:04:05,897 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/af643f11269743229a5427730d2bac24 to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/archive/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/f2/af643f11269743229a5427730d2bac24 2023-02-13 00:04:05,899 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/recovered.edits/12.seqid to hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/archive/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e/recovered.edits/12.seqid 2023-02-13 00:04:05,900 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/.tmp/data/default/testWithMockedMapReduceSingleRegion/0d2b8388e7ba9f4b6646204d926ba59e 2023-02-13 00:04:05,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 00:04:05,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,903 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-13 00:04:05,904 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-13 00:04:05,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-13 00:04:05,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246645905"}]},"ts":"9223372036854775807"} 2023-02-13 00:04:05,906 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 00:04:05,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0d2b8388e7ba9f4b6646204d926ba59e, NAME => 'testWithMockedMapReduceSingleRegion,,1676246644109.0d2b8388e7ba9f4b6646204d926ba59e.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 00:04:05,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-13 00:04:05,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676246645906"}]},"ts":"9223372036854775807"} 2023-02-13 00:04:05,907 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-13 00:04:05,909 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 00:04:05,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-13 00:04:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:04:05,987 INFO [Listener at localhost/46179] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-13 00:04:05,988 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:04:05,988 INFO [Listener at localhost/46179] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:04:05,988 DEBUG [Listener at localhost/46179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37ec8611 to 127.0.0.1:58180 2023-02-13 00:04:05,988 DEBUG [Listener at localhost/46179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:05,988 DEBUG [Listener at localhost/46179] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:04:05,988 DEBUG [Listener at localhost/46179] util.JVMClusterUtil(257): Found active master hash=661922347, stopped=false 2023-02-13 00:04:05,988 INFO [Listener at localhost/46179] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:05,992 INFO [Listener at localhost/46179] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:04:05,992 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:05,992 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:05,992 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:05,993 DEBUG [Listener at localhost/46179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x143efccb to 127.0.0.1:58180 2023-02-13 00:04:05,993 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:05,993 DEBUG [Listener at localhost/46179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:05,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:05,994 INFO [Listener at localhost/46179] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32865,1676246643031' ***** 2023-02-13 00:04:05,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:05,994 INFO [Listener at localhost/46179] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:04:05,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:05,994 INFO [RS:0;jenkins-hbase4:32865] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:04:05,994 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:04:05,994 INFO [Listener at localhost/46179] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38753,1676246643063' ***** 2023-02-13 00:04:05,994 INFO [RS:0;jenkins-hbase4:32865] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:04:05,995 INFO [Listener at localhost/46179] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:04:05,995 INFO [RS:0;jenkins-hbase4:32865] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:04:05,995 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:05,995 INFO [RS:1;jenkins-hbase4:38753] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:04:05,995 DEBUG [RS:0;jenkins-hbase4:32865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x010d1ce4 to 127.0.0.1:58180 2023-02-13 00:04:05,996 INFO [RS:1;jenkins-hbase4:38753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:04:05,996 DEBUG [RS:0;jenkins-hbase4:32865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:05,996 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:04:05,996 INFO [RS:0;jenkins-hbase4:32865] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:04:05,996 INFO [RS:0;jenkins-hbase4:32865] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:04:05,997 INFO [RS:0;jenkins-hbase4:32865] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:04:05,996 INFO [RS:1;jenkins-hbase4:38753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:04:05,997 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:04:05,997 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(3304): Received CLOSE for eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:05,997 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:05,997 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52765525 to 127.0.0.1:58180 2023-02-13 00:04:05,997 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eb8ce3fc23163070581fa6fd78a286df, disabling compactions & flushes 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:04:05,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:05,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:04:05,997 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 00:04:05,997 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:04:05,997 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 00:04:05,997 DEBUG [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:04:05,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-13 00:04:05,997 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1479): Online Regions={eb8ce3fc23163070581fa6fd78a286df=hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df.} 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. after waiting 0 ms 2023-02-13 00:04:05,997 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1505): Waiting on eb8ce3fc23163070581fa6fd78a286df 2023-02-13 00:04:05,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:05,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing eb8ce3fc23163070581fa6fd78a286df 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:04:06,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/.tmp/info/c04faf3d96054fbc878aba5c5afc0a86 2023-02-13 00:04:06,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/.tmp/info/f89d781329534d94aba8cdffa158bea6 2023-02-13 00:04:06,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c04faf3d96054fbc878aba5c5afc0a86 2023-02-13 00:04:06,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/.tmp/info/f89d781329534d94aba8cdffa158bea6 as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/info/f89d781329534d94aba8cdffa158bea6 2023-02-13 00:04:06,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/info/f89d781329534d94aba8cdffa158bea6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:04:06,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/.tmp/rep_barrier/164e63286d09497ea1dc0475454d34e8 2023-02-13 00:04:06,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for eb8ce3fc23163070581fa6fd78a286df in 18ms, sequenceid=6, compaction requested=false 2023-02-13 00:04:06,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/namespace/eb8ce3fc23163070581fa6fd78a286df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:04:06,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:06,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eb8ce3fc23163070581fa6fd78a286df: Waiting for close lock at 1676246645997Running coprocessor pre-close hooks at 1676246645997Disabling compacts and flushes for region at 1676246645997Disabling writes for close at 1676246645997Obtaining lock to block concurrent updates at 1676246645998 (+1 ms)Preparing flush snapshotting stores in eb8ce3fc23163070581fa6fd78a286df at 1676246645998Finished memstore snapshotting hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246645998Flushing stores of hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. at 1676246645998Flushing eb8ce3fc23163070581fa6fd78a286df/info: creating writer at 1676246645998Flushing eb8ce3fc23163070581fa6fd78a286df/info: appending metadata at 1676246646000 (+2 ms)Flushing eb8ce3fc23163070581fa6fd78a286df/info: closing flushed file at 1676246646001 (+1 ms)Flushing eb8ce3fc23163070581fa6fd78a286df/info: reopening flushed file at 1676246646011 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for eb8ce3fc23163070581fa6fd78a286df in 18ms, sequenceid=6, compaction requested=false at 1676246646016 (+5 ms)Writing region close event to WAL at 1676246646016Running coprocessor post-close hooks at 1676246646019 (+3 ms)Closed at 1676246646019 2023-02-13 00:04:06,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246643613.eb8ce3fc23163070581fa6fd78a286df. 2023-02-13 00:04:06,022 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 164e63286d09497ea1dc0475454d34e8 2023-02-13 00:04:06,029 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/.tmp/table/5d5d27f2292a4a8693d32c810109c27a 2023-02-13 00:04:06,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d5d27f2292a4a8693d32c810109c27a 2023-02-13 00:04:06,033 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/.tmp/info/c04faf3d96054fbc878aba5c5afc0a86 as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/info/c04faf3d96054fbc878aba5c5afc0a86 2023-02-13 00:04:06,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c04faf3d96054fbc878aba5c5afc0a86 2023-02-13 00:04:06,037 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/info/c04faf3d96054fbc878aba5c5afc0a86, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 00:04:06,037 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:06,038 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/.tmp/rep_barrier/164e63286d09497ea1dc0475454d34e8 as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/rep_barrier/164e63286d09497ea1dc0475454d34e8 2023-02-13 00:04:06,042 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:06,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 164e63286d09497ea1dc0475454d34e8 2023-02-13 00:04:06,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/rep_barrier/164e63286d09497ea1dc0475454d34e8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 00:04:06,044 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/.tmp/table/5d5d27f2292a4a8693d32c810109c27a as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/table/5d5d27f2292a4a8693d32c810109c27a 2023-02-13 00:04:06,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d5d27f2292a4a8693d32c810109c27a 2023-02-13 00:04:06,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/table/5d5d27f2292a4a8693d32c810109c27a, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 00:04:06,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-13 00:04:06,055 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 00:04:06,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:04:06,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:06,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246645997Running coprocessor pre-close hooks at 1676246645997Disabling compacts and flushes for region at 1676246645997Disabling writes for close at 1676246645997Obtaining lock to block concurrent updates at 1676246645997Preparing flush snapshotting stores in 1588230740 at 1676246645997Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676246645998 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676246645998Flushing 1588230740/info: creating writer at 1676246645998Flushing 1588230740/info: appending metadata at 1676246646000 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676246646001 (+1 ms)Flushing 1588230740/rep_barrier: creating writer at 1676246646009 (+8 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676246646011 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676246646011Flushing 1588230740/table: creating writer at 1676246646022 (+11 ms)Flushing 1588230740/table: appending metadata at 1676246646024 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676246646024Flushing 1588230740/info: reopening flushed file at 1676246646033 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676246646039 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676246646044 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false at 1676246646050 (+6 ms)Writing region close event to WAL at 1676246646053 (+3 ms)Running coprocessor post-close hooks at 1676246646056 (+3 ms)Closed at 1676246646056 2023-02-13 00:04:06,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:06,197 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32865,1676246643031; all regions closed. 2023-02-13 00:04:06,198 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38753,1676246643063; all regions closed. 2023-02-13 00:04:06,223 DEBUG [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/oldWALs 2023-02-13 00:04:06,223 INFO [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32865%2C1676246643031.meta:.meta(num 1676246643566) 2023-02-13 00:04:06,223 DEBUG [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/oldWALs 2023-02-13 00:04:06,223 INFO [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38753%2C1676246643063:(num 1676246643955) 2023-02-13 00:04:06,224 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:06,224 INFO [RS:1;jenkins-hbase4:38753] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:06,224 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:06,224 INFO [RS:1;jenkins-hbase4:38753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:04:06,224 INFO [RS:1;jenkins-hbase4:38753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:04:06,224 INFO [RS:1;jenkins-hbase4:38753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:04:06,226 INFO [RS:1;jenkins-hbase4:38753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38753 2023-02-13 00:04:06,226 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:06,228 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:06,228 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38753,1676246643063 2023-02-13 00:04:06,228 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:06,228 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b4e6d92 rejected from java.util.concurrent.ThreadPoolExecutor@7f71f623[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,228 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:06,228 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:06,228 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32916b1 rejected from java.util.concurrent.ThreadPoolExecutor@7f71f623[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,229 DEBUG [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/oldWALs 2023-02-13 00:04:06,229 INFO [RS:0;jenkins-hbase4:32865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32865%2C1676246643031:(num 1676246644362) 2023-02-13 00:04:06,229 DEBUG [RS:0;jenkins-hbase4:32865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:06,229 INFO [RS:0;jenkins-hbase4:32865] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:06,229 INFO [RS:0;jenkins-hbase4:32865] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:06,229 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:06,230 INFO [RS:0;jenkins-hbase4:32865] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32865 2023-02-13 00:04:06,230 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38753,1676246643063] 2023-02-13 00:04:06,230 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38753,1676246643063; numProcessing=1 2023-02-13 00:04:06,231 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32865,1676246643031 2023-02-13 00:04:06,231 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:06,231 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26ca382b rejected from java.util.concurrent.ThreadPoolExecutor@22f5a82a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,233 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38753,1676246643063 already deleted, retry=false 2023-02-13 00:04:06,233 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38753,1676246643063 expired; onlineServers=1 2023-02-13 00:04:06,234 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32865,1676246643031] 2023-02-13 00:04:06,234 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32865,1676246643031; numProcessing=2 2023-02-13 00:04:06,235 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32865,1676246643031 already deleted, retry=false 2023-02-13 00:04:06,235 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32865,1676246643031 expired; onlineServers=0 2023-02-13 00:04:06,235 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33817,1676246642983' ***** 2023-02-13 00:04:06,235 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:04:06,236 DEBUG [M:0;jenkins-hbase4:33817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@234ba21d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:06,236 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33817,1676246642983 2023-02-13 00:04:06,236 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33817,1676246642983; all regions closed. 2023-02-13 00:04:06,236 DEBUG [M:0;jenkins-hbase4:33817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:06,236 DEBUG [M:0;jenkins-hbase4:33817] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:04:06,236 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:04:06,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246643212] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246643212,5,FailOnTimeoutGroup] 2023-02-13 00:04:06,236 DEBUG [M:0;jenkins-hbase4:33817] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:04:06,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246643213] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246643213,5,FailOnTimeoutGroup] 2023-02-13 00:04:06,237 INFO [M:0;jenkins-hbase4:33817] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:04:06,238 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:06,238 INFO [M:0;jenkins-hbase4:33817] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:04:06,238 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:06,238 INFO [M:0;jenkins-hbase4:33817] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:04:06,238 DEBUG [M:0;jenkins-hbase4:33817] master.HMaster(1502): Stopping service threads 2023-02-13 00:04:06,238 INFO [M:0;jenkins-hbase4:33817] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:04:06,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:06,239 ERROR [M:0;jenkins-hbase4:33817] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 00:04:06,239 INFO [M:0;jenkins-hbase4:33817] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:04:06,239 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:04:06,239 DEBUG [M:0;jenkins-hbase4:33817] zookeeper.ZKUtil(398): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 00:04:06,239 WARN [M:0;jenkins-hbase4:33817] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 00:04:06,239 INFO [M:0;jenkins-hbase4:33817] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:04:06,240 INFO [M:0;jenkins-hbase4:33817] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:04:06,240 DEBUG [M:0;jenkins-hbase4:33817] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:06,240 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:06,240 DEBUG [M:0;jenkins-hbase4:33817] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:06,240 DEBUG [M:0;jenkins-hbase4:33817] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:06,240 DEBUG [M:0;jenkins-hbase4:33817] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:06,240 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.07 KB 2023-02-13 00:04:06,253 INFO [M:0;jenkins-hbase4:33817] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/daf84df8ffa146c591f34232f107be0e 2023-02-13 00:04:06,257 DEBUG [M:0;jenkins-hbase4:33817] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/daf84df8ffa146c591f34232f107be0e as hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/daf84df8ffa146c591f34232f107be0e 2023-02-13 00:04:06,260 INFO [M:0;jenkins-hbase4:33817] regionserver.HStore(1080): Added hdfs://localhost:36773/user/jenkins/test-data/1e2756bc-dfdb-6872-1190-bde7dba77a16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/daf84df8ffa146c591f34232f107be0e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 00:04:06,261 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57482, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-13 00:04:06,261 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:06,261 DEBUG [M:0;jenkins-hbase4:33817] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246646240Disabling compacts and flushes for region at 1676246646240Disabling writes for close at 1676246646240Obtaining lock to block concurrent updates at 1676246646240Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246646240Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57482, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1676246646240Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246646241 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246646242 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246646244 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246646244Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246646257 (+13 ms)Finished flush of dataSize ~56.13 KB/57482, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false at 1676246646261 (+4 ms)Writing region close event to WAL at 1676246646261Closed at 1676246646261 2023-02-13 00:04:06,265 INFO [M:0;jenkins-hbase4:33817] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:04:06,265 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:06,266 INFO [M:0;jenkins-hbase4:33817] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33817 2023-02-13 00:04:06,271 DEBUG [M:0;jenkins-hbase4:33817] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33817,1676246642983 already deleted, retry=false 2023-02-13 00:04:06,493 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:06,493 INFO [M:0;jenkins-hbase4:33817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33817,1676246642983; zookeeper connection closed. 2023-02-13 00:04:06,493 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37e56e4f rejected from java.util.concurrent.ThreadPoolExecutor@33dafc6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,494 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): master:33817-0x1004afddada0000, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:06,494 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b6faffb rejected from java.util.concurrent.ThreadPoolExecutor@33dafc6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,593 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:06,593 INFO [RS:0;jenkins-hbase4:32865] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32865,1676246643031; zookeeper connection closed. 2023-02-13 00:04:06,593 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21a62aa7 rejected from java.util.concurrent.ThreadPoolExecutor@22f5a82a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,593 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:32865-0x1004afddada0001, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:06,594 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59e113c1 rejected from java.util.concurrent.ThreadPoolExecutor@22f5a82a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,594 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a7ef8c3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a7ef8c3 2023-02-13 00:04:06,693 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:06,693 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38753,1676246643063; zookeeper connection closed. 2023-02-13 00:04:06,694 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b33f606 rejected from java.util.concurrent.ThreadPoolExecutor@7f71f623[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,696 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b74ec39] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b74ec39 2023-02-13 00:04:06,696 DEBUG [Listener at localhost/46179-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004afddada0002, quorum=127.0.0.1:58180, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:06,696 ERROR [Listener at localhost/46179-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@110b9182 rejected from java.util.concurrent.ThreadPoolExecutor@7f71f623[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:06,696 INFO [Listener at localhost/46179] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:04:06,697 WARN [Listener at localhost/46179] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:06,700 INFO [Listener at localhost/46179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:06,805 WARN [BP-54239421-172.31.14.131-1676246640990 heartbeating to localhost/127.0.0.1:36773] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:06,806 WARN [BP-54239421-172.31.14.131-1676246640990 heartbeating to localhost/127.0.0.1:36773] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-54239421-172.31.14.131-1676246640990 (Datanode Uuid 2081eea0-6fc4-445c-96db-c7e317a80602) service to localhost/127.0.0.1:36773 2023-02-13 00:04:06,807 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/dfs/data/data3/current/BP-54239421-172.31.14.131-1676246640990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:06,807 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/dfs/data/data4/current/BP-54239421-172.31.14.131-1676246640990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:06,808 WARN [Listener at localhost/46179] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:06,812 INFO [Listener at localhost/46179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:06,915 WARN [BP-54239421-172.31.14.131-1676246640990 heartbeating to localhost/127.0.0.1:36773] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:06,916 WARN [BP-54239421-172.31.14.131-1676246640990 heartbeating to localhost/127.0.0.1:36773] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-54239421-172.31.14.131-1676246640990 (Datanode Uuid 1430fcd2-0a4e-4fdd-83cd-221372035849) service to localhost/127.0.0.1:36773 2023-02-13 00:04:06,916 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/dfs/data/data1/current/BP-54239421-172.31.14.131-1676246640990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:06,917 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/cluster_794ab22d-dea0-4097-cb28-dab5f528a05d/dfs/data/data2/current/BP-54239421-172.31.14.131-1676246640990] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:06,929 INFO [Listener at localhost/46179] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:07,046 INFO [Listener at localhost/46179] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:04:07,060 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:04:07,072 INFO [Listener at localhost/46179] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 229) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36773 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46179 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33817,1676246642983)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36773 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36773 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36773 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36773 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:36773 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:36773 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46179.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=652 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 304), ProcessCount=168 (was 168), AvailableMemoryMB=3836 (was 3880) 2023-02-13 00:04:07,082 INFO [Listener at localhost/46179] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=168, AvailableMemoryMB=3836 2023-02-13 00:04:07,092 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/hadoop.log.dir so I do NOT create it in target/test-data/fee99288-8705-f587-adab-92ece6316307 2023-02-13 00:04:07,092 WARN [Listener at localhost/46179] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/hadoop.tmp.dir so I do NOT create it in target/test-data/fee99288-8705-f587-adab-92ece6316307 2023-02-13 00:04:07,093 WARN [Listener at localhost/46179] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c61c29a4-f283-1511-f541-2d62712a649d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 00:04:07,093 DEBUG [Listener at localhost/46179] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa, deleteOnExit=true 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/test.cache.data in system properties and HBase conf 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:04:07,093 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:04:07,094 DEBUG [Listener at localhost/46179] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:04:07,094 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:04:07,095 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:04:07,095 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:04:07,095 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:04:07,095 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:04:07,095 INFO [Listener at localhost/46179] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:04:07,124 WARN [Listener at localhost/46179] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:04:07,125 WARN [Listener at localhost/46179] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:04:07,164 WARN [Listener at localhost/46179] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:07,166 INFO [Listener at localhost/46179] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:07,171 INFO [Listener at localhost/46179] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/java.io.tmpdir/Jetty_localhost_36569_hdfs____.jqz0f5/webapp 2023-02-13 00:04:07,263 INFO [Listener at localhost/46179] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36569 2023-02-13 00:04:07,268 WARN [Listener at localhost/46179] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:04:07,268 WARN [Listener at localhost/46179] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:04:07,308 WARN [Listener at localhost/36303] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:07,323 WARN [Listener at localhost/36303] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:04:07,325 WARN [Listener at localhost/36303] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:07,326 INFO [Listener at localhost/36303] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:07,332 INFO [Listener at localhost/36303] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/java.io.tmpdir/Jetty_localhost_36883_datanode____.cx4qp5/webapp 2023-02-13 00:04:07,425 INFO [Listener at localhost/36303] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36883 2023-02-13 00:04:07,433 WARN [Listener at localhost/34173] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:07,447 WARN [Listener at localhost/34173] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:04:07,450 WARN [Listener at localhost/34173] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:07,451 INFO [Listener at localhost/34173] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:07,457 INFO [Listener at localhost/34173] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/java.io.tmpdir/Jetty_localhost_33107_datanode____rfavsv/webapp 2023-02-13 00:04:07,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x646db54759aabed4: Processing first storage report for DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777 from datanode a2b7cbfa-3957-44d7-a943-8880e0111f13 2023-02-13 00:04:07,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x646db54759aabed4: from storage DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777 node DatanodeRegistration(127.0.0.1:41059, datanodeUuid=a2b7cbfa-3957-44d7-a943-8880e0111f13, infoPort=38619, infoSecurePort=0, ipcPort=34173, storageInfo=lv=-57;cid=testClusterID;nsid=2080403223;c=1676246647128), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:07,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x646db54759aabed4: Processing first storage report for DS-e846e54c-8faf-461b-8839-cef6470488dd from datanode a2b7cbfa-3957-44d7-a943-8880e0111f13 2023-02-13 00:04:07,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x646db54759aabed4: from storage DS-e846e54c-8faf-461b-8839-cef6470488dd node DatanodeRegistration(127.0.0.1:41059, datanodeUuid=a2b7cbfa-3957-44d7-a943-8880e0111f13, infoPort=38619, infoSecurePort=0, ipcPort=34173, storageInfo=lv=-57;cid=testClusterID;nsid=2080403223;c=1676246647128), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:07,561 INFO [Listener at localhost/34173] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33107 2023-02-13 00:04:07,571 WARN [Listener at localhost/36019] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:07,684 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb14586e5abd22be7: Processing first storage report for DS-819de13f-7665-4d34-a287-fc8526c9dddb from datanode 155c4e6b-9eb6-451e-96a3-10708fa35803 2023-02-13 00:04:07,684 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb14586e5abd22be7: from storage DS-819de13f-7665-4d34-a287-fc8526c9dddb node DatanodeRegistration(127.0.0.1:43533, datanodeUuid=155c4e6b-9eb6-451e-96a3-10708fa35803, infoPort=40377, infoSecurePort=0, ipcPort=36019, storageInfo=lv=-57;cid=testClusterID;nsid=2080403223;c=1676246647128), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:07,684 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb14586e5abd22be7: Processing first storage report for DS-5093ab9f-d94c-4d6e-b790-7d7d8e15f69b from datanode 155c4e6b-9eb6-451e-96a3-10708fa35803 2023-02-13 00:04:07,684 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb14586e5abd22be7: from storage DS-5093ab9f-d94c-4d6e-b790-7d7d8e15f69b node DatanodeRegistration(127.0.0.1:43533, datanodeUuid=155c4e6b-9eb6-451e-96a3-10708fa35803, infoPort=40377, infoSecurePort=0, ipcPort=36019, storageInfo=lv=-57;cid=testClusterID;nsid=2080403223;c=1676246647128), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:07,781 DEBUG [Listener at localhost/36019] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307 2023-02-13 00:04:07,783 INFO [Listener at localhost/36019] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/zookeeper_0, clientPort=63222, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:04:07,784 INFO [Listener at localhost/36019] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63222 2023-02-13 00:04:07,784 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,785 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,799 INFO [Listener at localhost/36019] util.FSUtils(479): Created version file at hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64 with version=8 2023-02-13 00:04:07,799 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,800 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,801 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36303/user/jenkins/test-data/eabde64f-482d-aed8-d4f8-60f1a0a15c2d/hbase-staging 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:07,804 INFO [Listener at localhost/36019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:07,806 INFO [Listener at localhost/36019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44883 2023-02-13 00:04:07,806 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,807 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,807 INFO [Listener at localhost/36019] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44883 connecting to ZooKeeper ensemble=127.0.0.1:63222 2023-02-13 00:04:07,814 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:448830x0, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:07,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44883-0x1004afdedab0000 connected 2023-02-13 00:04:07,836 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:07,837 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:07,837 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:07,838 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44883 2023-02-13 00:04:07,840 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44883 2023-02-13 00:04:07,841 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44883 2023-02-13 00:04:07,843 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44883 2023-02-13 00:04:07,843 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44883 2023-02-13 00:04:07,843 INFO [Listener at localhost/36019] master.HMaster(439): hbase.rootdir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64, hbase.cluster.distributed=false 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:07,855 INFO [Listener at localhost/36019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:07,856 INFO [Listener at localhost/36019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39679 2023-02-13 00:04:07,856 INFO [Listener at localhost/36019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:04:07,860 DEBUG [Listener at localhost/36019] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:07,860 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,861 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,862 INFO [Listener at localhost/36019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39679 connecting to ZooKeeper ensemble=127.0.0.1:63222 2023-02-13 00:04:07,864 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:396790x0, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:07,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39679-0x1004afdedab0001 connected 2023-02-13 00:04:07,866 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:07,866 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:07,867 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:07,868 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39679 2023-02-13 00:04:07,868 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39679 2023-02-13 00:04:07,868 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39679 2023-02-13 00:04:07,872 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39679 2023-02-13 00:04:07,872 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39679 2023-02-13 00:04:07,882 INFO [Listener at localhost/36019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:07,882 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,883 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,883 INFO [Listener at localhost/36019] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:07,883 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:07,883 INFO [Listener at localhost/36019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:07,883 INFO [Listener at localhost/36019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:07,883 INFO [Listener at localhost/36019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44829 2023-02-13 00:04:07,884 INFO [Listener at localhost/36019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:04:07,884 DEBUG [Listener at localhost/36019] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:07,885 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,885 INFO [Listener at localhost/36019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,886 INFO [Listener at localhost/36019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44829 connecting to ZooKeeper ensemble=127.0.0.1:63222 2023-02-13 00:04:07,889 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:448290x0, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:07,889 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): regionserver:448290x0, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:07,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44829-0x1004afdedab0002 connected 2023-02-13 00:04:07,891 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:07,891 DEBUG [Listener at localhost/36019] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:07,892 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44829 2023-02-13 00:04:07,895 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44829 2023-02-13 00:04:07,896 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44829 2023-02-13 00:04:07,900 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44829 2023-02-13 00:04:07,900 DEBUG [Listener at localhost/36019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44829 2023-02-13 00:04:07,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:07,904 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:04:07,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:07,905 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:07,905 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:07,905 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:07,906 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:07,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:04:07,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44883,1676246647803 from backup master directory 2023-02-13 00:04:07,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:04:07,910 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:07,910 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:04:07,910 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:07,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:07,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/hbase.id with ID: f06e5427-3dbd-4e8f-9210-1353b681d53f 2023-02-13 00:04:07,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:07,934 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:07,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x34dc9c06 to 127.0.0.1:63222 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:07,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d3c9978, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:07,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:07,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:04:07,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:07,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store-tmp 2023-02-13 00:04:07,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:07,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:07,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:07,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:07,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:07,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:07,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:07,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246647957Disabling compacts and flushes for region at 1676246647957Disabling writes for close at 1676246647957Writing region close event to WAL at 1676246647957Closed at 1676246647957 2023-02-13 00:04:07,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/WALs/jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:07,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44883%2C1676246647803, suffix=, logDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/WALs/jenkins-hbase4.apache.org,44883,1676246647803, archiveDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/oldWALs, maxLogs=10 2023-02-13 00:04:07,972 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK] 2023-02-13 00:04:07,972 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK] 2023-02-13 00:04:07,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/WALs/jenkins-hbase4.apache.org,44883,1676246647803/jenkins-hbase4.apache.org%2C44883%2C1676246647803.1676246647960 2023-02-13 00:04:07,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK], DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK]] 2023-02-13 00:04:07,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:07,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:07,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:07,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:07,975 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:07,976 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:04:07,976 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:04:07,977 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:07,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:07,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:07,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:07,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:07,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69531070, jitterRate=0.036093682050704956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:04:07,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246647974Initializing all the Stores at 1676246647975 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246647975Cleaning up temporary data from old regions at 1676246647978 (+3 ms)Cleaning up detritus from prior splits at 1676246647978Region opened successfully at 1676246647981 (+3 ms) 2023-02-13 00:04:07,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:04:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:04:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:04:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:04:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 00:04:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 00:04:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:04:07,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:04:07,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:04:07,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:04:07,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:04:07,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:04:07,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:04:07,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:04:07,997 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:07,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:04:07,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:04:07,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:04:07,999 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:07,999 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:07,999 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:07,999 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:07,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44883,1676246647803, sessionid=0x1004afdedab0000, setting cluster-up flag (Was=false) 2023-02-13 00:04:08,005 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:08,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:04:08,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:08,013 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:08,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:04:08,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:08,018 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.hbase-snapshot/.tmp 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:08,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246678022 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:04:08,022 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:04:08,022 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:04:08,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:04:08,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:04:08,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:04:08,023 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:08,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:04:08,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:04:08,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246648024,5,FailOnTimeoutGroup] 2023-02-13 00:04:08,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246648024,5,FailOnTimeoutGroup] 2023-02-13 00:04:08,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:04:08,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,033 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:08,034 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:08,034 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64 2023-02-13 00:04:08,039 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:08,040 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:04:08,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/info 2023-02-13 00:04:08,041 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:04:08,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:04:08,042 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:08,043 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:04:08,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:04:08,044 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/table 2023-02-13 00:04:08,044 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:04:08,044 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,045 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740 2023-02-13 00:04:08,045 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740 2023-02-13 00:04:08,046 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:04:08,047 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:04:08,049 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:08,049 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64556457, jitterRate=-0.038033828139305115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:04:08,049 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246648039Initializing all the Stores at 1676246648040 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246648040Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246648040Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246648040Cleaning up temporary data from old regions at 1676246648046 (+6 ms)Cleaning up detritus from prior splits at 1676246648046Region opened successfully at 1676246648049 (+3 ms) 2023-02-13 00:04:08,049 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:04:08,049 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:04:08,049 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:04:08,049 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:04:08,049 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:04:08,050 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:08,050 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246648049Disabling compacts and flushes for region at 1676246648049Disabling writes for close at 1676246648049Writing region close event to WAL at 1676246648050 (+1 ms)Closed at 1676246648050 2023-02-13 00:04:08,050 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:08,050 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:04:08,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:04:08,052 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:04:08,053 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:04:08,103 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(952): ClusterId : f06e5427-3dbd-4e8f-9210-1353b681d53f 2023-02-13 00:04:08,103 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(952): ClusterId : f06e5427-3dbd-4e8f-9210-1353b681d53f 2023-02-13 00:04:08,103 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:04:08,103 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:04:08,105 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:04:08,105 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:04:08,105 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:04:08,105 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:04:08,108 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:04:08,109 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ReadOnlyZKClient(139): Connect 0x5eb119c2 to 127.0.0.1:63222 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:08,109 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:04:08,110 DEBUG [RS:0;jenkins-hbase4:39679] zookeeper.ReadOnlyZKClient(139): Connect 0x1ac4dff0 to 127.0.0.1:63222 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:08,113 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5076ec64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:08,113 DEBUG [RS:0;jenkins-hbase4:39679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140322d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:08,113 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@544972b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:08,113 DEBUG [RS:0;jenkins-hbase4:39679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103cb480, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:08,121 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39679 2023-02-13 00:04:08,121 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44829 2023-02-13 00:04:08,121 INFO [RS:0;jenkins-hbase4:39679] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:04:08,121 INFO [RS:1;jenkins-hbase4:44829] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:04:08,121 INFO [RS:0;jenkins-hbase4:39679] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:04:08,121 INFO [RS:1;jenkins-hbase4:44829] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:04:08,121 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:04:08,121 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:04:08,122 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44883,1676246647803 with isa=jenkins-hbase4.apache.org/172.31.14.131:39679, startcode=1676246647854 2023-02-13 00:04:08,122 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44883,1676246647803 with isa=jenkins-hbase4.apache.org/172.31.14.131:44829, startcode=1676246647882 2023-02-13 00:04:08,122 DEBUG [RS:0;jenkins-hbase4:39679] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:04:08,122 DEBUG [RS:1;jenkins-hbase4:44829] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:04:08,124 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57881, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:04:08,124 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47057, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:04:08,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44883] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,126 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64 2023-02-13 00:04:08,126 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64 2023-02-13 00:04:08,126 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36303 2023-02-13 00:04:08,126 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36303 2023-02-13 00:04:08,126 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:04:08,126 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:04:08,131 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:08,132 DEBUG [RS:0;jenkins-hbase4:39679] zookeeper.ZKUtil(162): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,132 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ZKUtil(162): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,132 WARN [RS:0;jenkins-hbase4:39679] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:08,132 WARN [RS:1;jenkins-hbase4:44829] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:08,132 INFO [RS:0;jenkins-hbase4:39679] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:08,132 INFO [RS:1;jenkins-hbase4:44829] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:08,132 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,132 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,132 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39679,1676246647854] 2023-02-13 00:04:08,132 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44829,1676246647882] 2023-02-13 00:04:08,136 DEBUG [RS:0;jenkins-hbase4:39679] zookeeper.ZKUtil(162): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,136 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ZKUtil(162): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,137 DEBUG [RS:0;jenkins-hbase4:39679] zookeeper.ZKUtil(162): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,137 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ZKUtil(162): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,137 DEBUG [RS:1;jenkins-hbase4:44829] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:04:08,137 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:04:08,137 INFO [RS:1;jenkins-hbase4:44829] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:04:08,137 INFO [RS:0;jenkins-hbase4:39679] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:04:08,138 INFO [RS:1;jenkins-hbase4:44829] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:04:08,139 INFO [RS:1;jenkins-hbase4:44829] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:04:08,139 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,139 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:04:08,140 INFO [RS:0;jenkins-hbase4:39679] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:04:08,144 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,144 INFO [RS:0;jenkins-hbase4:39679] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:04:08,144 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,144 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,144 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,144 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,145 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,145 DEBUG [RS:1;jenkins-hbase4:44829] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,146 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,146 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,146 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,147 DEBUG [RS:0;jenkins-hbase4:39679] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:08,148 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,148 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,149 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,159 INFO [RS:0;jenkins-hbase4:39679] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:04:08,159 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39679,1676246647854-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,163 INFO [RS:1;jenkins-hbase4:44829] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:04:08,164 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44829,1676246647882-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,169 INFO [RS:0;jenkins-hbase4:39679] regionserver.Replication(203): jenkins-hbase4.apache.org,39679,1676246647854 started 2023-02-13 00:04:08,169 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39679,1676246647854, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39679, sessionid=0x1004afdedab0001 2023-02-13 00:04:08,169 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:04:08,169 DEBUG [RS:0;jenkins-hbase4:39679] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,169 DEBUG [RS:0;jenkins-hbase4:39679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39679,1676246647854' 2023-02-13 00:04:08,169 DEBUG [RS:0;jenkins-hbase4:39679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39679,1676246647854' 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:08,170 DEBUG [RS:0;jenkins-hbase4:39679] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:04:08,170 INFO [RS:0;jenkins-hbase4:39679] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:04:08,171 INFO [RS:0;jenkins-hbase4:39679] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:04:08,177 INFO [RS:1;jenkins-hbase4:44829] regionserver.Replication(203): jenkins-hbase4.apache.org,44829,1676246647882 started 2023-02-13 00:04:08,178 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44829,1676246647882, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44829, sessionid=0x1004afdedab0002 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44829,1676246647882' 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44829,1676246647882' 2023-02-13 00:04:08,178 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:08,179 DEBUG [RS:1;jenkins-hbase4:44829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:08,179 DEBUG [RS:1;jenkins-hbase4:44829] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:04:08,179 INFO [RS:1;jenkins-hbase4:44829] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:04:08,179 INFO [RS:1;jenkins-hbase4:44829] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:04:08,203 DEBUG [jenkins-hbase4:44883] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:04:08,203 DEBUG [jenkins-hbase4:44883] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:08,204 DEBUG [jenkins-hbase4:44883] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:08,205 DEBUG [jenkins-hbase4:44883] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:08,205 DEBUG [jenkins-hbase4:44883] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:08,205 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39679,1676246647854, state=OPENING 2023-02-13 00:04:08,206 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:04:08,207 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:08,207 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:04:08,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39679,1676246647854}] 2023-02-13 00:04:08,362 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,363 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:04:08,364 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48414, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:04:08,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:04:08,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:08,370 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39679%2C1676246647854.meta, suffix=.meta, logDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,39679,1676246647854, archiveDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/oldWALs, maxLogs=32 2023-02-13 00:04:08,383 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK] 2023-02-13 00:04:08,383 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK] 2023-02-13 00:04:08,384 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,39679,1676246647854/jenkins-hbase4.apache.org%2C39679%2C1676246647854.meta.1676246648370.meta 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK], DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK]] 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:04:08,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:04:08,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:04:08,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:04:08,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/info 2023-02-13 00:04:08,387 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/info 2023-02-13 00:04:08,387 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:04:08,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:04:08,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:08,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:08,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:04:08,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:04:08,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/table 2023-02-13 00:04:08,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/table 2023-02-13 00:04:08,390 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:04:08,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,391 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740 2023-02-13 00:04:08,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740 2023-02-13 00:04:08,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:04:08,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:04:08,395 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63707175, jitterRate=-0.05068911612033844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:04:08,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246648385Writing region info on filesystem at 1676246648385Initializing all the Stores at 1676246648386 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246648386Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246648386Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246648386Cleaning up temporary data from old regions at 1676246648393 (+7 ms)Cleaning up detritus from prior splits at 1676246648393Running coprocessor post-open hooks at 1676246648395 (+2 ms)Region opened successfully at 1676246648395 2023-02-13 00:04:08,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246648362 2023-02-13 00:04:08,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:04:08,399 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:04:08,400 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39679,1676246647854, state=OPEN 2023-02-13 00:04:08,401 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:04:08,401 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:04:08,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:04:08,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39679,1676246647854 in 194 msec 2023-02-13 00:04:08,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:04:08,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-13 00:04:08,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 385 msec 2023-02-13 00:04:08,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246647904, completionTime=-1 2023-02-13 00:04:08,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:04:08,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:04:08,407 DEBUG [hconnection-0x405fb039-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:08,408 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:08,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:04:08,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246708410 2023-02-13 00:04:08,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246768410 2023-02-13 00:04:08,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44883,1676246647803-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44883,1676246647803-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44883,1676246647803-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44883, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:04:08,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:08,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:04:08,420 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:04:08,420 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:04:08,421 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:04:08,422 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,422 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558 empty. 2023-02-13 00:04:08,423 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,423 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:04:08,430 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:08,431 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0ab1dc7969bc02570e3b73742f02f558, NAME => 'hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp 2023-02-13 00:04:08,436 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:08,436 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 0ab1dc7969bc02570e3b73742f02f558, disabling compactions & flushes 2023-02-13 00:04:08,436 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,436 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,436 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. after waiting 0 ms 2023-02-13 00:04:08,436 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,436 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,436 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 0ab1dc7969bc02570e3b73742f02f558: Waiting for close lock at 1676246648436Disabling compacts and flushes for region at 1676246648436Disabling writes for close at 1676246648436Writing region close event to WAL at 1676246648436Closed at 1676246648436 2023-02-13 00:04:08,438 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:04:08,439 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246648439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246648439"}]},"ts":"1676246648439"} 2023-02-13 00:04:08,440 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:04:08,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:04:08,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246648440"}]},"ts":"1676246648440"} 2023-02-13 00:04:08,441 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:04:08,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:08,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:08,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:08,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:08,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0ab1dc7969bc02570e3b73742f02f558, ASSIGN}] 2023-02-13 00:04:08,447 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0ab1dc7969bc02570e3b73742f02f558, ASSIGN 2023-02-13 00:04:08,448 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0ab1dc7969bc02570e3b73742f02f558, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39679,1676246647854; forceNewPlan=false, retain=false 2023-02-13 00:04:08,598 INFO [jenkins-hbase4:44883] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:04:08,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0ab1dc7969bc02570e3b73742f02f558, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,598 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246648598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246648598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246648598"}]},"ts":"1676246648598"} 2023-02-13 00:04:08,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0ab1dc7969bc02570e3b73742f02f558, server=jenkins-hbase4.apache.org,39679,1676246647854}] 2023-02-13 00:04:08,754 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,755 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39679%2C1676246647854, suffix=, logDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,39679,1676246647854, archiveDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/oldWALs, maxLogs=32 2023-02-13 00:04:08,767 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK] 2023-02-13 00:04:08,767 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK] 2023-02-13 00:04:08,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,39679,1676246647854/jenkins-hbase4.apache.org%2C39679%2C1676246647854.1676246648756 2023-02-13 00:04:08,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK], DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK]] 2023-02-13 00:04:08,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0ab1dc7969bc02570e3b73742f02f558, NAME => 'hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:08,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:08,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,771 INFO [StoreOpener-0ab1dc7969bc02570e3b73742f02f558-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,772 DEBUG [StoreOpener-0ab1dc7969bc02570e3b73742f02f558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/info 2023-02-13 00:04:08,773 DEBUG [StoreOpener-0ab1dc7969bc02570e3b73742f02f558-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/info 2023-02-13 00:04:08,773 INFO [StoreOpener-0ab1dc7969bc02570e3b73742f02f558-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ab1dc7969bc02570e3b73742f02f558 columnFamilyName info 2023-02-13 00:04:08,773 INFO [StoreOpener-0ab1dc7969bc02570e3b73742f02f558-1] regionserver.HStore(310): Store=0ab1dc7969bc02570e3b73742f02f558/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:08,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:08,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:08,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0ab1dc7969bc02570e3b73742f02f558; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67747736, jitterRate=0.00951993465423584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:04:08,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0ab1dc7969bc02570e3b73742f02f558: Running coprocessor pre-open hook at 1676246648771Writing region info on filesystem at 1676246648771Initializing all the Stores at 1676246648771Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246648771Cleaning up temporary data from old regions at 1676246648774 (+3 ms)Cleaning up detritus from prior splits at 1676246648774Running coprocessor post-open hooks at 1676246648777 (+3 ms)Region opened successfully at 1676246648777 2023-02-13 00:04:08,778 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558., pid=6, masterSystemTime=1676246648751 2023-02-13 00:04:08,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,779 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:08,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0ab1dc7969bc02570e3b73742f02f558, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:08,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246648779"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246648779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246648779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246648779"}]},"ts":"1676246648779"} 2023-02-13 00:04:08,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:04:08,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0ab1dc7969bc02570e3b73742f02f558, server=jenkins-hbase4.apache.org,39679,1676246647854 in 181 msec 2023-02-13 00:04:08,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:04:08,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0ab1dc7969bc02570e3b73742f02f558, ASSIGN in 338 msec 2023-02-13 00:04:08,784 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:04:08,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246648784"}]},"ts":"1676246648784"} 2023-02-13 00:04:08,785 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:04:08,788 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:04:08,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 370 msec 2023-02-13 00:04:08,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:04:08,821 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:08,821 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:08,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:04:08,830 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:08,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-13 00:04:08,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:04:08,842 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:08,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 00:04:08,848 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:04:08,851 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:04:08,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.941sec 2023-02-13 00:04:08,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:04:08,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:04:08,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:04:08,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44883,1676246647803-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:04:08,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44883,1676246647803-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:04:08,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:04:08,903 DEBUG [Listener at localhost/36019] zookeeper.ReadOnlyZKClient(139): Connect 0x4c824b6d to 127.0.0.1:63222 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:08,906 DEBUG [Listener at localhost/36019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@155f234e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:08,907 DEBUG [hconnection-0x770d4e0d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:08,909 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:08,910 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:08,910 DEBUG [Listener at localhost/36019] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:04:08,912 DEBUG [Listener at localhost/36019] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:04:08,913 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:04:08,914 INFO [Listener at localhost/36019] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:08,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:08,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:04:08,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:56122 deadline: 1676246708914, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:08,915 INFO [Listener at localhost/36019] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 00:04:08,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:08,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:08,919 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:04:08,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-13 00:04:08,919 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:04:08,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:08,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:08,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 empty. 2023-02-13 00:04:08,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:08,921 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 00:04:08,929 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:08,931 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => efccde520a6b4825fc79b61698cadb01, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp 2023-02-13 00:04:08,936 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:08,936 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing efccde520a6b4825fc79b61698cadb01, disabling compactions & flushes 2023-02-13 00:04:08,937 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:08,937 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:08,937 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. after waiting 0 ms 2023-02-13 00:04:08,937 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:08,937 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:08,937 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for efccde520a6b4825fc79b61698cadb01: Waiting for close lock at 1676246648936Disabling compacts and flushes for region at 1676246648936Disabling writes for close at 1676246648937 (+1 ms)Writing region close event to WAL at 1676246648937Closed at 1676246648937 2023-02-13 00:04:08,938 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:04:08,939 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676246648939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246648939"}]},"ts":"1676246648939"} 2023-02-13 00:04:08,940 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:04:08,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:04:08,941 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246648941"}]},"ts":"1676246648941"} 2023-02-13 00:04:08,942 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-13 00:04:08,949 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:08,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:08,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:08,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:08,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, ASSIGN}] 2023-02-13 00:04:08,952 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, ASSIGN 2023-02-13 00:04:08,953 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39679,1676246647854; forceNewPlan=false, retain=false 2023-02-13 00:04:09,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:09,083 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 00:04:09,103 INFO [jenkins-hbase4:44883] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:04:09,103 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=efccde520a6b4825fc79b61698cadb01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,103 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676246649103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246649103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246649103"}]},"ts":"1676246649103"} 2023-02-13 00:04:09,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure efccde520a6b4825fc79b61698cadb01, server=jenkins-hbase4.apache.org,39679,1676246647854}] 2023-02-13 00:04:09,181 INFO [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44829%2C1676246647882, suffix=, logDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,44829,1676246647882, archiveDir=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/oldWALs, maxLogs=32 2023-02-13 00:04:09,210 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK] 2023-02-13 00:04:09,210 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK] 2023-02-13 00:04:09,212 INFO [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,44829,1676246647882/jenkins-hbase4.apache.org%2C44829%2C1676246647882.1676246649181 2023-02-13 00:04:09,212 DEBUG [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41059,DS-ce875a5c-a5ec-4135-ab9f-12a2096b5777,DISK], DatanodeInfoWithStorage[127.0.0.1:43533,DS-819de13f-7665-4d34-a287-fc8526c9dddb,DISK]] 2023-02-13 00:04:09,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:09,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:09,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => efccde520a6b4825fc79b61698cadb01, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:09,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:09,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,263 INFO [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,264 DEBUG [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1 2023-02-13 00:04:09,264 DEBUG [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1 2023-02-13 00:04:09,265 INFO [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efccde520a6b4825fc79b61698cadb01 columnFamilyName f1 2023-02-13 00:04:09,265 INFO [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] regionserver.HStore(310): Store=efccde520a6b4825fc79b61698cadb01/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:09,265 INFO [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,266 DEBUG [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2 2023-02-13 00:04:09,266 DEBUG [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2 2023-02-13 00:04:09,266 INFO [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efccde520a6b4825fc79b61698cadb01 columnFamilyName f2 2023-02-13 00:04:09,267 INFO [StoreOpener-efccde520a6b4825fc79b61698cadb01-1] regionserver.HStore(310): Store=efccde520a6b4825fc79b61698cadb01/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:09,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:04:09,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:09,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:09,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened efccde520a6b4825fc79b61698cadb01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69755031, jitterRate=0.03943096101284027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:04:09,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for efccde520a6b4825fc79b61698cadb01: Running coprocessor pre-open hook at 1676246649262Writing region info on filesystem at 1676246649262Initializing all the Stores at 1676246649263 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246649263Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246649263Cleaning up temporary data from old regions at 1676246649268 (+5 ms)Cleaning up detritus from prior splits at 1676246649268Running coprocessor post-open hooks at 1676246649271 (+3 ms)Region opened successfully at 1676246649271 2023-02-13 00:04:09,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01., pid=12, masterSystemTime=1676246649259 2023-02-13 00:04:09,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:09,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:09,274 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=efccde520a6b4825fc79b61698cadb01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,274 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676246649273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246649273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246649273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246649273"}]},"ts":"1676246649273"} 2023-02-13 00:04:09,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 00:04:09,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure efccde520a6b4825fc79b61698cadb01, server=jenkins-hbase4.apache.org,39679,1676246647854 in 170 msec 2023-02-13 00:04:09,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 00:04:09,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, ASSIGN in 326 msec 2023-02-13 00:04:09,278 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:04:09,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246649278"}]},"ts":"1676246649278"} 2023-02-13 00:04:09,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-13 00:04:09,281 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:04:09,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 364 msec 2023-02-13 00:04:09,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:09,524 INFO [Listener at localhost/36019] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-13 00:04:09,524 DEBUG [Listener at localhost/36019] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-13 00:04:09,524 INFO [Listener at localhost/36019] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:04:09,526 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-13 00:04:09,526 INFO [Listener at localhost/36019] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:04:09,526 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-13 00:04:09,526 INFO [Listener at localhost/36019] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:04:09,555 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39679] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:09,635 INFO [Listener at localhost/36019] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:04:09,635 INFO [Listener at localhost/36019] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:04:09,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 00:04:09,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246649636 (current time:1676246649636). 2023-02-13 00:04:09,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:04:09,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] zookeeper.ReadOnlyZKClient(139): Connect 0x013dbdaf to 127.0.0.1:63222 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:09,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d48d95b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:09,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:09,641 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48438, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:09,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x013dbdaf to 127.0.0.1:63222 2023-02-13 00:04:09,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:09,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:04:09,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 00:04:09,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 00:04:09,645 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 00:04:09,646 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676247249646 2023-02-13 00:04:09,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 00:04:09,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:09,647 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:04:09,647 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:04:09,648 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 00:04:09,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 00:04:09,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-13 00:04:09,650 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 00:04:09,650 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676247249650 2023-02-13 00:04:09,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 00:04:09,657 INFO [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 00:04:09,657 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:09,658 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 00:04:09,658 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 00:04:09,658 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,658 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,661 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,661 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:09,661 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:09,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:09,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:09,661 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,661 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:04:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 00:04:09,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 00:04:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 00:04:09,662 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 00:04:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 00:04:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 00:04:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:09,663 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44829,1676246647882' joining acquired barrier for procedure (foo) in zk 2023-02-13 00:04:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 00:04:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 00:04:09,664 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39679,1676246647854' joining acquired barrier for procedure (foo) in zk 2023-02-13 00:04:09,665 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,665 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,665 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:09,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:09,665 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,665 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:09,665 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,665 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:09,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:04:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:09,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39679,1676246647854' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 00:04:09,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dedd8bc[Count = 0] remaining members to acquire global barrier 2023-02-13 00:04:09,667 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 00:04:09,667 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 00:04:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 00:04:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 00:04:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44829,1676246647882' in zk 2023-02-13 00:04:09,668 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,668 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:04:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 00:04:09,668 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:04:09,668 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:09,668 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. started... 2023-02-13 00:04:09,669 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HRegion(2744): Flushing efccde520a6b4825fc79b61698cadb01 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 00:04:09,670 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 00:04:09,670 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:09,670 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 00:04:09,688 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f1/f4447f011d564327ac8ef5dd13030053 2023-02-13 00:04:09,704 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f2/f16be1a15e6047cf93691ea8edf0d366 2023-02-13 00:04:09,708 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f1/f4447f011d564327ac8ef5dd13030053 as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053 2023-02-13 00:04:09,711 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:04:09,712 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f2/f16be1a15e6047cf93691ea8edf0d366 as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366 2023-02-13 00:04:09,715 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:04:09,716 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for efccde520a6b4825fc79b61698cadb01 in 47ms, sequenceid=5, compaction requested=false 2023-02-13 00:04:09,716 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for efccde520a6b4825fc79b61698cadb01: 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.' region-info for snapshot=foo 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053] hfiles 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053 for snapshot=foo 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366] hfiles 2023-02-13 00:04:09,717 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366 for snapshot=foo 2023-02-13 00:04:09,725 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. completed. 2023-02-13 00:04:09,725 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:09,725 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 00:04:09,725 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 00:04:09,725 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,725 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 00:04:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39679,1676246647854' in zk 2023-02-13 00:04:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 00:04:09,729 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:09,729 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 00:04:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:04:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:04:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,39679,1676246647854': 2023-02-13 00:04:09,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39679,1676246647854' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 00:04:09,732 INFO [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 00:04:09,732 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:04:09,732 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:04:09,732 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 00:04:09,732 INFO [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:04:09,734 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:09,734 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:09,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,734 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:09,735 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:09,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:09,735 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:04:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,737 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:09,737 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 00:04:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:09,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:09,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 00:04:09,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:09,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 00:04:09,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:09,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:09,742 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:09,742 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,743 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 00:04:09,743 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:09,743 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,743 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:09,743 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 00:04:09,743 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 00:04:09,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:09,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:09,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:09,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:09,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.hbase-snapshot/.tmp/foo 2023-02-13 00:04:09,747 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:09,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 00:04:09,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:04:09,749 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:04:09,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.hbase-snapshot/.tmp/foo to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.hbase-snapshot/foo 2023-02-13 00:04:09,949 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:09,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 00:04:09,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:04:09,951 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 00:04:10,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-13 00:04:10,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.hbase-snapshot/.tmp/foo 2023-02-13 00:04:10,178 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.hbase-snapshot/.tmp/foo 2023-02-13 00:04:10,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676246649646Consolidate snapshot: foo at 1676246649742 (+96 ms)Loading Region manifests for foo at 1676246649742Writing data manifest for foo at 1676246649746 (+4 ms)Verifying snapshot: foo at 1676246649756 (+10 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676246650178 (+422 ms) 2023-02-13 00:04:10,180 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 00:04:10,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 533 msec 2023-02-13 00:04:10,251 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:10,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 00:04:10,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:04:10,252 INFO [Listener at localhost/36019] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:04:10,255 INFO [Listener at localhost/36019] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:04:10,259 INFO [Listener at localhost/36019] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:04:10,285 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39679] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,364 INFO [Listener at localhost/36019] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:04:10,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:04:10,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,371 INFO [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 00:04:10,371 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:10,372 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-13 00:04:10,372 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-13 00:04:10,372 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,372 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,375 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:10,375 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:10,375 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:10,375 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,375 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:04:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,376 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 00:04:10,376 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 00:04:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 00:04:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:04:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 00:04:10,377 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:10,377 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. started... 2023-02-13 00:04:10,378 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 00:04:10,378 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 00:04:10,378 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44829,1676246647882' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 00:04:10,378 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing efccde520a6b4825fc79b61698cadb01 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 00:04:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:10,392 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f1/62a92540a3c84249ab4ee9afebc2eb4f 2023-02-13 00:04:10,409 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f2/ace6cd78db4a4be8ba5a705fc3e78c7a 2023-02-13 00:04:10,413 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f1/62a92540a3c84249ab4ee9afebc2eb4f as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/62a92540a3c84249ab4ee9afebc2eb4f 2023-02-13 00:04:10,417 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/62a92540a3c84249ab4ee9afebc2eb4f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:04:10,417 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/.tmp/f2/ace6cd78db4a4be8ba5a705fc3e78c7a as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/ace6cd78db4a4be8ba5a705fc3e78c7a 2023-02-13 00:04:10,421 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/ace6cd78db4a4be8ba5a705fc3e78c7a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:04:10,422 INFO [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for efccde520a6b4825fc79b61698cadb01 in 44ms, sequenceid=9, compaction requested=false 2023-02-13 00:04:10,423 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for efccde520a6b4825fc79b61698cadb01: 2023-02-13 00:04:10,423 DEBUG [rs(jenkins-hbase4.apache.org,39679,1676246647854)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 00:04:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 00:04:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 00:04:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39679,1676246647854' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 00:04:10,424 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,424 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:10,425 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,425 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:10,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39679,1676246647854' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-13 00:04:10,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d243d9[Count = 0] remaining members to acquire global barrier 2023-02-13 00:04:10,426 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-13 00:04:10,426 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,427 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,427 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 00:04:10,428 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,428 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:04:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 00:04:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,39679,1676246647854' in zk 2023-02-13 00:04:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 00:04:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 00:04:10,428 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44829,1676246647882' in zk 2023-02-13 00:04:10,430 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 00:04:10,430 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,430 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 00:04:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:10,430 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,39679,1676246647854' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 00:04:10,431 DEBUG [member: 'jenkins-hbase4.apache.org,44829,1676246647882' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 00:04:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,39679,1676246647854': 2023-02-13 00:04:10,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39679,1676246647854' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-13 00:04:10,433 INFO [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-13 00:04:10,433 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:04:10,433 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:04:10,433 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,434 INFO [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:04:10,435 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:10,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,435 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:10,436 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:10,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,436 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,441 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:10,441 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,443 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:10,444 DEBUG [(jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:10,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:10,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:10,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:10,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:10,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 00:04:10,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:10,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:10,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-13 00:04:10,444 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,445 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:04:10,445 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,445 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,545 DEBUG [Listener at localhost/36019] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:04:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:04:10,549 INFO [Listener at localhost/36019] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676246649636 type: FLUSH version: 2 ttl: 0 2023-02-13 00:04:10,550 DEBUG [Listener at localhost/36019] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36303/user/jenkins/test-data/eabde64f-482d-aed8-d4f8-60f1a0a15c2d/foo/5b547b9d-e553-47b3-9fc7-4f92f6351c88/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,550 INFO [Listener at localhost/36019] snapshot.RestoreSnapshotHelper(239): region to add: efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:10,550 INFO [Listener at localhost/36019] snapshot.RestoreSnapshotHelper(585): clone region=efccde520a6b4825fc79b61698cadb01 as efccde520a6b4825fc79b61698cadb01 in snapshot foo 2023-02-13 00:04:10,551 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => efccde520a6b4825fc79b61698cadb01, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36303/user/jenkins/test-data/eabde64f-482d-aed8-d4f8-60f1a0a15c2d/foo/5b547b9d-e553-47b3-9fc7-4f92f6351c88 2023-02-13 00:04:10,556 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:10,556 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4447f011d564327ac8ef5dd13030053 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,558 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f16be1a15e6047cf93691ea8edf0d366 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,559 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing efccde520a6b4825fc79b61698cadb01, disabling compactions & flushes 2023-02-13 00:04:10,560 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,560 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,560 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. after waiting 0 ms 2023-02-13 00:04:10,560 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,560 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,560 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for efccde520a6b4825fc79b61698cadb01: Waiting for close lock at 1676246650559Disabling compacts and flushes for region at 1676246650559Disabling writes for close at 1676246650560 (+1 ms)Writing region close event to WAL at 1676246650560Closed at 1676246650560 2023-02-13 00:04:10,561 INFO [Listener at localhost/36019] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676246649636 type: FLUSH version: 2 ttl: 0 2023-02-13 00:04:10,562 DEBUG [Listener at localhost/36019] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36303/user/jenkins/test-data/eabde64f-482d-aed8-d4f8-60f1a0a15c2d/foo/5b547b9d-e553-47b3-9fc7-4f92f6351c88 2023-02-13 00:04:10,562 DEBUG [Listener at localhost/36019] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36303/user/jenkins/test-data/eabde64f-482d-aed8-d4f8-60f1a0a15c2d/foo/5b547b9d-e553-47b3-9fc7-4f92f6351c88 2023-02-13 00:04:10,562 DEBUG [Listener at localhost/36019] util.CommonFSUtils(699): |-data/ 2023-02-13 00:04:10,562 DEBUG [Listener at localhost/36019] util.CommonFSUtils(699): |----default/ 2023-02-13 00:04:10,563 DEBUG [Listener at localhost/36019] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-13 00:04:10,563 DEBUG [Listener at localhost/36019] util.CommonFSUtils(699): |----------efccde520a6b4825fc79b61698cadb01/ 2023-02-13 00:04:10,563 DEBUG [Listener at localhost/36019] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:04:10,563 DEBUG [Listener at localhost/36019] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:04:10,563 DEBUG [Listener at localhost/36019] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=efccde520a6b4825fc79b61698cadb01-f4447f011d564327ac8ef5dd13030053 2023-02-13 00:04:10,563 DEBUG [Listener at localhost/36019] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:04:10,564 DEBUG [Listener at localhost/36019] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=efccde520a6b4825fc79b61698cadb01-f16be1a15e6047cf93691ea8edf0d366 hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/62a92540a3c84249ab4ee9afebc2eb4f hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053 hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/ace6cd78db4a4be8ba5a705fc3e78c7a hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366 2023-02-13 00:04:10,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 00:04:10,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 00:04:10,571 INFO [Listener at localhost/36019] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:10,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246650575"}]},"ts":"1676246650575"} 2023-02-13 00:04:10,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-13 00:04:10,578 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-13 00:04:10,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, UNASSIGN}] 2023-02-13 00:04:10,580 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, UNASSIGN 2023-02-13 00:04:10,580 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=efccde520a6b4825fc79b61698cadb01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,581 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676246650580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246650580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246650580"}]},"ts":"1676246650580"} 2023-02-13 00:04:10,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure efccde520a6b4825fc79b61698cadb01, server=jenkins-hbase4.apache.org,39679,1676246647854}] 2023-02-13 00:04:10,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:10,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:10,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing efccde520a6b4825fc79b61698cadb01, disabling compactions & flushes 2023-02-13 00:04:10,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. after waiting 0 ms 2023-02-13 00:04:10,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:04:10,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01. 2023-02-13 00:04:10,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for efccde520a6b4825fc79b61698cadb01: Waiting for close lock at 1676246650734Running coprocessor pre-close hooks at 1676246650734Disabling compacts and flushes for region at 1676246650734Disabling writes for close at 1676246650734Writing region close event to WAL at 1676246650735 (+1 ms)Running coprocessor post-close hooks at 1676246650738 (+3 ms)Closed at 1676246650738 2023-02-13 00:04:10,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:10,739 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=efccde520a6b4825fc79b61698cadb01, regionState=CLOSED 2023-02-13 00:04:10,739 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676246650739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246650739"}]},"ts":"1676246650739"} 2023-02-13 00:04:10,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 00:04:10,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure efccde520a6b4825fc79b61698cadb01, server=jenkins-hbase4.apache.org,39679,1676246647854 in 159 msec 2023-02-13 00:04:10,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 00:04:10,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=efccde520a6b4825fc79b61698cadb01, UNASSIGN in 164 msec 2023-02-13 00:04:10,743 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246650743"}]},"ts":"1676246650743"} 2023-02-13 00:04:10,744 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-13 00:04:10,747 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-13 00:04:10,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-13 00:04:10,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:10,879 INFO [Listener at localhost/36019] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-13 00:04:10,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:04:10,887 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:10,889 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1, FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2, FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/recovered.edits] 2023-02-13 00:04:10,892 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/62a92540a3c84249ab4ee9afebc2eb4f to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/62a92540a3c84249ab4ee9afebc2eb4f 2023-02-13 00:04:10,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053 to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f1/f4447f011d564327ac8ef5dd13030053 2023-02-13 00:04:10,896 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/ace6cd78db4a4be8ba5a705fc3e78c7a to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/ace6cd78db4a4be8ba5a705fc3e78c7a 2023-02-13 00:04:10,897 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366 to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/f2/f16be1a15e6047cf93691ea8edf0d366 2023-02-13 00:04:10,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/recovered.edits/12.seqid to hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01/recovered.edits/12.seqid 2023-02-13 00:04:10,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/efccde520a6b4825fc79b61698cadb01 2023-02-13 00:04:10,899 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 00:04:10,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,903 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-13 00:04:10,904 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-13 00:04:10,908 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,908 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-13 00:04:10,909 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246650908"}]},"ts":"9223372036854775807"} 2023-02-13 00:04:10,910 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 00:04:10,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => efccde520a6b4825fc79b61698cadb01, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676246648916.efccde520a6b4825fc79b61698cadb01.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 00:04:10,910 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-13 00:04:10,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676246650910"}]},"ts":"9223372036854775807"} 2023-02-13 00:04:10,911 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-13 00:04:10,913 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 00:04:10,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 33 msec 2023-02-13 00:04:10,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44883] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:04:10,985 INFO [Listener at localhost/36019] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-13 00:04:10,986 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:04:10,986 INFO [Listener at localhost/36019] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:04:10,986 DEBUG [Listener at localhost/36019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c824b6d to 127.0.0.1:63222 2023-02-13 00:04:10,986 DEBUG [Listener at localhost/36019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:10,986 DEBUG [Listener at localhost/36019] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:04:10,986 DEBUG [Listener at localhost/36019] util.JVMClusterUtil(257): Found active master hash=2104431844, stopped=false 2023-02-13 00:04:10,986 INFO [Listener at localhost/36019] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:10,988 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:10,988 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:10,988 INFO [Listener at localhost/36019] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:04:10,988 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:10,988 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:10,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:10,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:10,990 DEBUG [Listener at localhost/36019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34dc9c06 to 127.0.0.1:63222 2023-02-13 00:04:10,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:10,990 DEBUG [Listener at localhost/36019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:10,991 INFO [Listener at localhost/36019] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39679,1676246647854' ***** 2023-02-13 00:04:10,991 INFO [Listener at localhost/36019] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:04:10,991 INFO [Listener at localhost/36019] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44829,1676246647882' ***** 2023-02-13 00:04:10,991 INFO [Listener at localhost/36019] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:04:10,991 INFO [RS:0;jenkins-hbase4:39679] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:04:10,991 INFO [RS:1;jenkins-hbase4:44829] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:04:10,991 INFO [RS:0;jenkins-hbase4:39679] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:04:10,991 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:04:10,991 INFO [RS:0;jenkins-hbase4:39679] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:04:10,991 INFO [RS:1;jenkins-hbase4:44829] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:04:10,991 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:04:10,992 INFO [RS:1;jenkins-hbase4:44829] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:04:10,992 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(3304): Received CLOSE for 0ab1dc7969bc02570e3b73742f02f558 2023-02-13 00:04:10,993 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:10,993 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:10,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0ab1dc7969bc02570e3b73742f02f558, disabling compactions & flushes 2023-02-13 00:04:10,993 DEBUG [RS:0;jenkins-hbase4:39679] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ac4dff0 to 127.0.0.1:63222 2023-02-13 00:04:10,993 DEBUG [RS:1;jenkins-hbase4:44829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5eb119c2 to 127.0.0.1:63222 2023-02-13 00:04:10,994 DEBUG [RS:0;jenkins-hbase4:39679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:10,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:10,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:10,994 INFO [RS:0;jenkins-hbase4:39679] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:04:10,994 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:10,994 INFO [RS:0;jenkins-hbase4:39679] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:04:10,994 INFO [RS:0;jenkins-hbase4:39679] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:04:10,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. after waiting 0 ms 2023-02-13 00:04:10,994 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:04:10,994 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44829,1676246647882; all regions closed. 2023-02-13 00:04:10,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:10,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 0ab1dc7969bc02570e3b73742f02f558 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:04:10,994 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 00:04:10,994 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1479): Online Regions={0ab1dc7969bc02570e3b73742f02f558=hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558., 1588230740=hbase:meta,,1.1588230740} 2023-02-13 00:04:10,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:04:10,994 DEBUG [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1505): Waiting on 0ab1dc7969bc02570e3b73742f02f558, 1588230740 2023-02-13 00:04:10,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:04:10,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:04:10,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:04:10,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:04:10,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-13 00:04:11,001 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/WALs/jenkins-hbase4.apache.org,44829,1676246647882/jenkins-hbase4.apache.org%2C44829%2C1676246647882.1676246649181 not finished, retry = 0 2023-02-13 00:04:11,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/.tmp/info/e0cd00a0f9564cc983eb1351585c1044 2023-02-13 00:04:11,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/.tmp/info/e0cd00a0f9564cc983eb1351585c1044 as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/info/e0cd00a0f9564cc983eb1351585c1044 2023-02-13 00:04:11,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/info/e0cd00a0f9564cc983eb1351585c1044, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:04:11,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0ab1dc7969bc02570e3b73742f02f558 in 25ms, sequenceid=6, compaction requested=false 2023-02-13 00:04:11,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/.tmp/info/205345b6d9a940e5ad394bc47bada87d 2023-02-13 00:04:11,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 205345b6d9a940e5ad394bc47bada87d 2023-02-13 00:04:11,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/namespace/0ab1dc7969bc02570e3b73742f02f558/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:04:11,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:11,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0ab1dc7969bc02570e3b73742f02f558: Waiting for close lock at 1676246650993Running coprocessor pre-close hooks at 1676246650993Disabling compacts and flushes for region at 1676246650993Disabling writes for close at 1676246650994 (+1 ms)Obtaining lock to block concurrent updates at 1676246650994Preparing flush snapshotting stores in 0ab1dc7969bc02570e3b73742f02f558 at 1676246650994Finished memstore snapshotting hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246650995 (+1 ms)Flushing stores of hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. at 1676246650995Flushing 0ab1dc7969bc02570e3b73742f02f558/info: creating writer at 1676246650995Flushing 0ab1dc7969bc02570e3b73742f02f558/info: appending metadata at 1676246650998 (+3 ms)Flushing 0ab1dc7969bc02570e3b73742f02f558/info: closing flushed file at 1676246650998Flushing 0ab1dc7969bc02570e3b73742f02f558/info: reopening flushed file at 1676246651015 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0ab1dc7969bc02570e3b73742f02f558 in 25ms, sequenceid=6, compaction requested=false at 1676246651019 (+4 ms)Writing region close event to WAL at 1676246651025 (+6 ms)Running coprocessor post-close hooks at 1676246651033 (+8 ms)Closed at 1676246651034 (+1 ms) 2023-02-13 00:04:11,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246648418.0ab1dc7969bc02570e3b73742f02f558. 2023-02-13 00:04:11,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/.tmp/rep_barrier/cba0f3ae5a5c47b2ab27073649968e61 2023-02-13 00:04:11,044 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cba0f3ae5a5c47b2ab27073649968e61 2023-02-13 00:04:11,049 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:11,051 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:11,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/.tmp/table/16d3b6f223ff47d4827a29473bd3d0a5 2023-02-13 00:04:11,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16d3b6f223ff47d4827a29473bd3d0a5 2023-02-13 00:04:11,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/.tmp/info/205345b6d9a940e5ad394bc47bada87d as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/info/205345b6d9a940e5ad394bc47bada87d 2023-02-13 00:04:11,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 205345b6d9a940e5ad394bc47bada87d 2023-02-13 00:04:11,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/info/205345b6d9a940e5ad394bc47bada87d, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 00:04:11,061 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/.tmp/rep_barrier/cba0f3ae5a5c47b2ab27073649968e61 as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/rep_barrier/cba0f3ae5a5c47b2ab27073649968e61 2023-02-13 00:04:11,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cba0f3ae5a5c47b2ab27073649968e61 2023-02-13 00:04:11,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/rep_barrier/cba0f3ae5a5c47b2ab27073649968e61, entries=1, sequenceid=21, filesize=5.1 K 2023-02-13 00:04:11,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/.tmp/table/16d3b6f223ff47d4827a29473bd3d0a5 as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/table/16d3b6f223ff47d4827a29473bd3d0a5 2023-02-13 00:04:11,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16d3b6f223ff47d4827a29473bd3d0a5 2023-02-13 00:04:11,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/table/16d3b6f223ff47d4827a29473bd3d0a5, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 00:04:11,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 74ms, sequenceid=21, compaction requested=false 2023-02-13 00:04:11,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 00:04:11,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:04:11,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:11,074 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246650994Running coprocessor pre-close hooks at 1676246650994Disabling compacts and flushes for region at 1676246650994Disabling writes for close at 1676246650995 (+1 ms)Obtaining lock to block concurrent updates at 1676246650995Preparing flush snapshotting stores in 1588230740 at 1676246650995Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676246650995Flushing stores of hbase:meta,,1.1588230740 at 1676246650998 (+3 ms)Flushing 1588230740/info: creating writer at 1676246650998Flushing 1588230740/info: appending metadata at 1676246651004 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676246651004Flushing 1588230740/rep_barrier: creating writer at 1676246651032 (+28 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676246651035 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676246651035Flushing 1588230740/table: creating writer at 1676246651044 (+9 ms)Flushing 1588230740/table: appending metadata at 1676246651045 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676246651045Flushing 1588230740/info: reopening flushed file at 1676246651058 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676246651061 (+3 ms)Flushing 1588230740/table: reopening flushed file at 1676246651065 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 74ms, sequenceid=21, compaction requested=false at 1676246651069 (+4 ms)Writing region close event to WAL at 1676246651070 (+1 ms)Running coprocessor post-close hooks at 1676246651072 (+2 ms)Closed at 1676246651074 (+2 ms) 2023-02-13 00:04:11,074 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:11,104 DEBUG [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/oldWALs 2023-02-13 00:04:11,104 INFO [RS:1;jenkins-hbase4:44829] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44829%2C1676246647882:(num 1676246649181) 2023-02-13 00:04:11,104 DEBUG [RS:1;jenkins-hbase4:44829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:11,104 INFO [RS:1;jenkins-hbase4:44829] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:11,104 INFO [RS:1;jenkins-hbase4:44829] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:11,104 INFO [RS:1;jenkins-hbase4:44829] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:04:11,104 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:11,104 INFO [RS:1;jenkins-hbase4:44829] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:04:11,104 INFO [RS:1;jenkins-hbase4:44829] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:04:11,106 INFO [RS:1;jenkins-hbase4:44829] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44829 2023-02-13 00:04:11,107 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:11,107 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44829,1676246647882 2023-02-13 00:04:11,107 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:11,107 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@236d21c5 rejected from java.util.concurrent.ThreadPoolExecutor@2752a170[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,107 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:11,107 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:11,107 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1951177e rejected from java.util.concurrent.ThreadPoolExecutor@2752a170[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,108 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44829,1676246647882] 2023-02-13 00:04:11,108 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44829,1676246647882; numProcessing=1 2023-02-13 00:04:11,113 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44829,1676246647882 already deleted, retry=false 2023-02-13 00:04:11,113 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44829,1676246647882 expired; onlineServers=1 2023-02-13 00:04:11,148 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 00:04:11,149 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 00:04:11,195 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39679,1676246647854; all regions closed. 2023-02-13 00:04:11,199 DEBUG [RS:0;jenkins-hbase4:39679] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/oldWALs 2023-02-13 00:04:11,199 INFO [RS:0;jenkins-hbase4:39679] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39679%2C1676246647854.meta:.meta(num 1676246648370) 2023-02-13 00:04:11,202 DEBUG [RS:0;jenkins-hbase4:39679] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/oldWALs 2023-02-13 00:04:11,202 INFO [RS:0;jenkins-hbase4:39679] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39679%2C1676246647854:(num 1676246648756) 2023-02-13 00:04:11,202 DEBUG [RS:0;jenkins-hbase4:39679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:11,202 INFO [RS:0;jenkins-hbase4:39679] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:11,203 INFO [RS:0;jenkins-hbase4:39679] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:11,203 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:11,204 INFO [RS:0;jenkins-hbase4:39679] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39679 2023-02-13 00:04:11,205 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39679,1676246647854 2023-02-13 00:04:11,205 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:11,205 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17287793 rejected from java.util.concurrent.ThreadPoolExecutor@1317e1ae[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,206 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39679,1676246647854] 2023-02-13 00:04:11,206 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39679,1676246647854; numProcessing=2 2023-02-13 00:04:11,207 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39679,1676246647854 already deleted, retry=false 2023-02-13 00:04:11,207 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39679,1676246647854 expired; onlineServers=0 2023-02-13 00:04:11,207 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44883,1676246647803' ***** 2023-02-13 00:04:11,207 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:04:11,208 DEBUG [M:0;jenkins-hbase4:44883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79509f91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:11,208 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44883,1676246647803 2023-02-13 00:04:11,209 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44883,1676246647803; all regions closed. 2023-02-13 00:04:11,209 DEBUG [M:0;jenkins-hbase4:44883] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:11,209 DEBUG [M:0;jenkins-hbase4:44883] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:04:11,209 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:04:11,209 DEBUG [M:0;jenkins-hbase4:44883] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:04:11,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246648024] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246648024,5,FailOnTimeoutGroup] 2023-02-13 00:04:11,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246648024] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246648024,5,FailOnTimeoutGroup] 2023-02-13 00:04:11,209 INFO [M:0;jenkins-hbase4:44883] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:04:11,210 INFO [M:0;jenkins-hbase4:44883] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:04:11,210 INFO [M:0;jenkins-hbase4:44883] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:04:11,210 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:11,210 DEBUG [M:0;jenkins-hbase4:44883] master.HMaster(1502): Stopping service threads 2023-02-13 00:04:11,210 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:11,210 INFO [M:0;jenkins-hbase4:44883] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:04:11,211 ERROR [M:0;jenkins-hbase4:44883] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 00:04:11,211 INFO [M:0;jenkins-hbase4:44883] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:04:11,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:11,211 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:04:11,211 DEBUG [M:0;jenkins-hbase4:44883] zookeeper.ZKUtil(398): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 00:04:11,211 WARN [M:0;jenkins-hbase4:44883] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 00:04:11,211 INFO [M:0;jenkins-hbase4:44883] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:04:11,212 INFO [M:0;jenkins-hbase4:44883] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:04:11,212 DEBUG [M:0;jenkins-hbase4:44883] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:11,212 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:11,212 DEBUG [M:0;jenkins-hbase4:44883] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:11,212 DEBUG [M:0;jenkins-hbase4:44883] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:11,212 DEBUG [M:0;jenkins-hbase4:44883] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:11,212 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.69 KB heapSize=67.70 KB 2023-02-13 00:04:11,220 INFO [M:0;jenkins-hbase4:44883] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eb24ecb4a75948e597c00330e3171a7b 2023-02-13 00:04:11,224 DEBUG [M:0;jenkins-hbase4:44883] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eb24ecb4a75948e597c00330e3171a7b as hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eb24ecb4a75948e597c00330e3171a7b 2023-02-13 00:04:11,228 INFO [M:0;jenkins-hbase4:44883] regionserver.HStore(1080): Added hdfs://localhost:36303/user/jenkins/test-data/03c54b6e-6207-2d16-e5df-5b1285927c64/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eb24ecb4a75948e597c00330e3171a7b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 00:04:11,229 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegion(2947): Finished flush of dataSize ~56.69 KB/58051, heapSize ~67.68 KB/69304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-13 00:04:11,229 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:11,229 DEBUG [M:0;jenkins-hbase4:44883] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246651212Disabling compacts and flushes for region at 1676246651212Disabling writes for close at 1676246651212Obtaining lock to block concurrent updates at 1676246651212Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246651212Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58051, getHeapSize=69304, getOffHeapSize=0, getCellsCount=145 at 1676246651213 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246651213Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246651213Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246651215 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246651215Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246651224 (+9 ms)Finished flush of dataSize ~56.69 KB/58051, heapSize ~67.68 KB/69304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676246651229 (+5 ms)Writing region close event to WAL at 1676246651229Closed at 1676246651229 2023-02-13 00:04:11,231 INFO [M:0;jenkins-hbase4:44883] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:04:11,231 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:11,232 INFO [M:0;jenkins-hbase4:44883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44883 2023-02-13 00:04:11,234 DEBUG [M:0;jenkins-hbase4:44883] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44883,1676246647803 already deleted, retry=false 2023-02-13 00:04:11,490 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:11,490 INFO [M:0;jenkins-hbase4:44883] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44883,1676246647803; zookeeper connection closed. 2023-02-13 00:04:11,490 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a47f723 rejected from java.util.concurrent.ThreadPoolExecutor@4e787ab3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,491 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): master:44883-0x1004afdedab0000, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:11,491 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4fb0fbbd rejected from java.util.concurrent.ThreadPoolExecutor@4e787ab3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,590 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:11,590 INFO [RS:0;jenkins-hbase4:39679] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39679,1676246647854; zookeeper connection closed. 2023-02-13 00:04:11,590 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33c9a4ce rejected from java.util.concurrent.ThreadPoolExecutor@1317e1ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,591 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:39679-0x1004afdedab0001, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:11,591 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bbf4e05 rejected from java.util.concurrent.ThreadPoolExecutor@1317e1ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,591 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9f4f66a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9f4f66a 2023-02-13 00:04:11,690 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:11,691 INFO [RS:1;jenkins-hbase4:44829] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44829,1676246647882; zookeeper connection closed. 2023-02-13 00:04:11,691 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@61930ca6 rejected from java.util.concurrent.ThreadPoolExecutor@2752a170[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,691 DEBUG [Listener at localhost/36019-EventThread] zookeeper.ZKWatcher(600): regionserver:44829-0x1004afdedab0002, quorum=127.0.0.1:63222, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:11,691 ERROR [Listener at localhost/36019-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1384c967 rejected from java.util.concurrent.ThreadPoolExecutor@2752a170[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:11,691 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50171679] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50171679 2023-02-13 00:04:11,691 INFO [Listener at localhost/36019] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:04:11,691 WARN [Listener at localhost/36019] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:11,695 INFO [Listener at localhost/36019] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:11,798 WARN [BP-1461907909-172.31.14.131-1676246647128 heartbeating to localhost/127.0.0.1:36303] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:11,798 WARN [BP-1461907909-172.31.14.131-1676246647128 heartbeating to localhost/127.0.0.1:36303] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1461907909-172.31.14.131-1676246647128 (Datanode Uuid 155c4e6b-9eb6-451e-96a3-10708fa35803) service to localhost/127.0.0.1:36303 2023-02-13 00:04:11,799 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/dfs/data/data3/current/BP-1461907909-172.31.14.131-1676246647128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:11,799 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/dfs/data/data4/current/BP-1461907909-172.31.14.131-1676246647128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:11,800 WARN [Listener at localhost/36019] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:11,803 INFO [Listener at localhost/36019] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:11,908 WARN [BP-1461907909-172.31.14.131-1676246647128 heartbeating to localhost/127.0.0.1:36303] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:11,911 WARN [BP-1461907909-172.31.14.131-1676246647128 heartbeating to localhost/127.0.0.1:36303] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1461907909-172.31.14.131-1676246647128 (Datanode Uuid a2b7cbfa-3957-44d7-a943-8880e0111f13) service to localhost/127.0.0.1:36303 2023-02-13 00:04:11,912 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/dfs/data/data1/current/BP-1461907909-172.31.14.131-1676246647128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:11,913 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/cluster_f55d867a-3dec-0a24-61b0-aa86686348fa/dfs/data/data2/current/BP-1461907909-172.31.14.131-1676246647128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:11,921 INFO [Listener at localhost/36019] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:12,034 INFO [Listener at localhost/36019] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:04:12,048 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:04:12,063 INFO [Listener at localhost/36019] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36019 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36303 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:36303 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44883,1676246647803)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36303 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36303 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36303 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:36303 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:36303 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=577 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 280), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=3791 (was 3836) 2023-02-13 00:04:12,073 INFO [Listener at localhost/36019] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=170, AvailableMemoryMB=3790 2023-02-13 00:04:12,083 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/hadoop.log.dir so I do NOT create it in target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177 2023-02-13 00:04:12,083 WARN [Listener at localhost/36019] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 00:04:12,083 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/hadoop.tmp.dir so I do NOT create it in target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177 2023-02-13 00:04:12,083 WARN [Listener at localhost/36019] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fee99288-8705-f587-adab-92ece6316307/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 00:04:12,083 DEBUG [Listener at localhost/36019] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d, deleteOnExit=true 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/test.cache.data in system properties and HBase conf 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/hadoop.log.dir in system properties and HBase conf 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 00:04:12,084 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 00:04:12,085 DEBUG [Listener at localhost/36019] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:04:12,085 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 00:04:12,086 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/nfs.dump.dir in system properties and HBase conf 2023-02-13 00:04:12,086 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/java.io.tmpdir in system properties and HBase conf 2023-02-13 00:04:12,086 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 00:04:12,086 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 00:04:12,086 INFO [Listener at localhost/36019] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 00:04:12,090 WARN [Listener at localhost/36019] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:04:12,090 WARN [Listener at localhost/36019] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:04:12,135 WARN [Listener at localhost/36019] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:12,136 INFO [Listener at localhost/36019] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:12,140 INFO [Listener at localhost/36019] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/java.io.tmpdir/Jetty_localhost_46771_hdfs____9samux/webapp 2023-02-13 00:04:12,265 INFO [Listener at localhost/36019] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46771 2023-02-13 00:04:12,270 WARN [Listener at localhost/36019] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 00:04:12,270 WARN [Listener at localhost/36019] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 00:04:12,309 WARN [Listener at localhost/38667] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:12,321 WARN [Listener at localhost/38667] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:04:12,323 WARN [Listener at localhost/38667] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:12,325 INFO [Listener at localhost/38667] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:12,333 INFO [Listener at localhost/38667] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/java.io.tmpdir/Jetty_localhost_36569_datanode____.t2t06c/webapp 2023-02-13 00:04:12,425 INFO [Listener at localhost/38667] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36569 2023-02-13 00:04:12,434 WARN [Listener at localhost/40585] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:12,453 WARN [Listener at localhost/40585] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 00:04:12,455 WARN [Listener at localhost/40585] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 00:04:12,456 INFO [Listener at localhost/40585] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 00:04:12,460 INFO [Listener at localhost/40585] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/java.io.tmpdir/Jetty_localhost_43525_datanode____gepc0/webapp 2023-02-13 00:04:12,534 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x220889115d08a532: Processing first storage report for DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820 from datanode 34ba6270-3490-49b4-a6ac-c1c79397c3db 2023-02-13 00:04:12,534 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x220889115d08a532: from storage DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820 node DatanodeRegistration(127.0.0.1:39187, datanodeUuid=34ba6270-3490-49b4-a6ac-c1c79397c3db, infoPort=44355, infoSecurePort=0, ipcPort=40585, storageInfo=lv=-57;cid=testClusterID;nsid=1788287703;c=1676246652093), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:12,534 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x220889115d08a532: Processing first storage report for DS-7c9ca954-7e38-4467-8149-b10f7cf61d13 from datanode 34ba6270-3490-49b4-a6ac-c1c79397c3db 2023-02-13 00:04:12,534 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x220889115d08a532: from storage DS-7c9ca954-7e38-4467-8149-b10f7cf61d13 node DatanodeRegistration(127.0.0.1:39187, datanodeUuid=34ba6270-3490-49b4-a6ac-c1c79397c3db, infoPort=44355, infoSecurePort=0, ipcPort=40585, storageInfo=lv=-57;cid=testClusterID;nsid=1788287703;c=1676246652093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:12,561 INFO [Listener at localhost/40585] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43525 2023-02-13 00:04:12,568 WARN [Listener at localhost/38351] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 00:04:12,653 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb7eec520bede02d7: Processing first storage report for DS-b44ed607-3853-4ec5-bb04-914d5a52a072 from datanode 7d344d08-512a-40be-bc3c-5a30aba64519 2023-02-13 00:04:12,653 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb7eec520bede02d7: from storage DS-b44ed607-3853-4ec5-bb04-914d5a52a072 node DatanodeRegistration(127.0.0.1:38737, datanodeUuid=7d344d08-512a-40be-bc3c-5a30aba64519, infoPort=46523, infoSecurePort=0, ipcPort=38351, storageInfo=lv=-57;cid=testClusterID;nsid=1788287703;c=1676246652093), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:12,653 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb7eec520bede02d7: Processing first storage report for DS-691b5252-b46d-44b8-af90-83aca65339e6 from datanode 7d344d08-512a-40be-bc3c-5a30aba64519 2023-02-13 00:04:12,653 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb7eec520bede02d7: from storage DS-691b5252-b46d-44b8-af90-83aca65339e6 node DatanodeRegistration(127.0.0.1:38737, datanodeUuid=7d344d08-512a-40be-bc3c-5a30aba64519, infoPort=46523, infoSecurePort=0, ipcPort=38351, storageInfo=lv=-57;cid=testClusterID;nsid=1788287703;c=1676246652093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 00:04:12,678 DEBUG [Listener at localhost/38351] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177 2023-02-13 00:04:12,680 INFO [Listener at localhost/38351] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/zookeeper_0, clientPort=56761, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 00:04:12,681 INFO [Listener at localhost/38351] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56761 2023-02-13 00:04:12,681 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,682 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,694 INFO [Listener at localhost/38351] util.FSUtils(479): Created version file at hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e with version=8 2023-02-13 00:04:12,694 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,695 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,696 INFO [Listener at localhost/38351] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/hbase-staging 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:12,698 INFO [Listener at localhost/38351] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:12,699 INFO [Listener at localhost/38351] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38801 2023-02-13 00:04:12,699 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,700 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,701 INFO [Listener at localhost/38351] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38801 connecting to ZooKeeper ensemble=127.0.0.1:56761 2023-02-13 00:04:12,708 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:388010x0, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:12,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38801-0x1004afe00cd0000 connected 2023-02-13 00:04:12,729 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:12,730 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:12,730 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:12,731 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38801 2023-02-13 00:04:12,731 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38801 2023-02-13 00:04:12,732 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38801 2023-02-13 00:04:12,736 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38801 2023-02-13 00:04:12,736 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38801 2023-02-13 00:04:12,736 INFO [Listener at localhost/38351] master.HMaster(439): hbase.rootdir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e, hbase.cluster.distributed=false 2023-02-13 00:04:12,748 INFO [Listener at localhost/38351] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:12,748 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,748 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,748 INFO [Listener at localhost/38351] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:12,748 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,748 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:12,749 INFO [Listener at localhost/38351] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:12,749 INFO [Listener at localhost/38351] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44821 2023-02-13 00:04:12,749 INFO [Listener at localhost/38351] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:04:12,750 DEBUG [Listener at localhost/38351] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:12,750 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,751 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,752 INFO [Listener at localhost/38351] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44821 connecting to ZooKeeper ensemble=127.0.0.1:56761 2023-02-13 00:04:12,758 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:448210x0, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:12,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44821-0x1004afe00cd0001 connected 2023-02-13 00:04:12,760 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:12,761 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:12,762 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:12,762 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44821 2023-02-13 00:04:12,762 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44821 2023-02-13 00:04:12,764 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44821 2023-02-13 00:04:12,768 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44821 2023-02-13 00:04:12,768 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44821 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 00:04:12,779 INFO [Listener at localhost/38351] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 00:04:12,781 INFO [Listener at localhost/38351] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42551 2023-02-13 00:04:12,781 INFO [Listener at localhost/38351] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 00:04:12,782 DEBUG [Listener at localhost/38351] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:12,782 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,783 INFO [Listener at localhost/38351] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,784 INFO [Listener at localhost/38351] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42551 connecting to ZooKeeper ensemble=127.0.0.1:56761 2023-02-13 00:04:12,788 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:425510x0, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 00:04:12,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42551-0x1004afe00cd0002 connected 2023-02-13 00:04:12,789 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:12,790 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:12,790 DEBUG [Listener at localhost/38351] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 00:04:12,792 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42551 2023-02-13 00:04:12,794 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42551 2023-02-13 00:04:12,795 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42551 2023-02-13 00:04:12,796 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42551 2023-02-13 00:04:12,796 DEBUG [Listener at localhost/38351] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42551 2023-02-13 00:04:12,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,802 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:04:12,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,804 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:12,804 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:12,804 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:12,806 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:12,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:04:12,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38801,1676246652697 from backup master directory 2023-02-13 00:04:12,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 00:04:12,810 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,810 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 00:04:12,810 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:12,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/hbase.id with ID: 96d82d9e-5571-4b8c-9ab0-d2fd94667cd6 2023-02-13 00:04:12,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 00:04:12,830 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:12,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x38c88518 to 127.0.0.1:56761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:12,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644c7d7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:12,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:12,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 00:04:12,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:12,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store-tmp 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:12,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:12,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246652853Disabling compacts and flushes for region at 1676246652853Disabling writes for close at 1676246652853Writing region close event to WAL at 1676246652853Closed at 1676246652853 2023-02-13 00:04:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/WALs/jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38801%2C1676246652697, suffix=, logDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/WALs/jenkins-hbase4.apache.org,38801,1676246652697, archiveDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/oldWALs, maxLogs=10 2023-02-13 00:04:12,867 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK] 2023-02-13 00:04:12,867 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK] 2023-02-13 00:04:12,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/WALs/jenkins-hbase4.apache.org,38801,1676246652697/jenkins-hbase4.apache.org%2C38801%2C1676246652697.1676246652855 2023-02-13 00:04:12,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK], DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK]] 2023-02-13 00:04:12,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:12,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:12,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:12,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:12,872 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:12,873 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 00:04:12,873 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 00:04:12,874 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:12,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:12,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:12,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 00:04:12,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:12,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63677485, jitterRate=-0.05113153159618378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:04:12,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676246652870Initializing all the Stores at 1676246652871 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246652871Cleaning up temporary data from old regions at 1676246652875 (+4 ms)Cleaning up detritus from prior splits at 1676246652875Region opened successfully at 1676246652880 (+5 ms) 2023-02-13 00:04:12,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 00:04:12,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 00:04:12,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 00:04:12,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 00:04:12,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 00:04:12,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 00:04:12,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 00:04:12,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 00:04:12,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 00:04:12,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 00:04:12,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 00:04:12,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 00:04:12,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 00:04:12,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 00:04:12,897 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:12,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 00:04:12,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 00:04:12,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 00:04:12,900 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:12,900 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:12,900 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:12,900 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:12,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,38801,1676246652697, sessionid=0x1004afe00cd0000, setting cluster-up flag (Was=false) 2023-02-13 00:04:12,907 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:12,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 00:04:12,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,915 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:12,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 00:04:12,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:12,926 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.hbase-snapshot/.tmp 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:12,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676246682930 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 00:04:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 00:04:12,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:12,932 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:12,932 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 00:04:12,933 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:12,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 00:04:12,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 00:04:12,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 00:04:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 00:04:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 00:04:12,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246652940,5,FailOnTimeoutGroup] 2023-02-13 00:04:12,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246652940,5,FailOnTimeoutGroup] 2023-02-13 00:04:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 00:04:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:12,945 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:12,945 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:12,945 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e 2023-02-13 00:04:12,952 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:12,952 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:04:12,953 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/info 2023-02-13 00:04:12,954 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:04:12,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:12,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:04:12,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:12,955 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:04:12,956 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:12,956 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:04:12,957 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/table 2023-02-13 00:04:12,957 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:04:12,957 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:12,958 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740 2023-02-13 00:04:12,958 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740 2023-02-13 00:04:12,959 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:04:12,960 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:04:12,962 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:12,962 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61458412, jitterRate=-0.08419829607009888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:04:12,962 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676246652952Initializing all the Stores at 1676246652952Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246652952Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246652952Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246652952Cleaning up temporary data from old regions at 1676246652958 (+6 ms)Cleaning up detritus from prior splits at 1676246652959 (+1 ms)Region opened successfully at 1676246652962 (+3 ms) 2023-02-13 00:04:12,962 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:04:12,962 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:04:12,962 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:04:12,962 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:04:12,962 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:04:12,962 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:12,963 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246652962Disabling compacts and flushes for region at 1676246652962Disabling writes for close at 1676246652962Writing region close event to WAL at 1676246652962Closed at 1676246652962 2023-02-13 00:04:12,963 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 00:04:12,963 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 00:04:12,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 00:04:12,965 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 00:04:12,967 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 00:04:13,002 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(952): ClusterId : 96d82d9e-5571-4b8c-9ab0-d2fd94667cd6 2023-02-13 00:04:13,002 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(952): ClusterId : 96d82d9e-5571-4b8c-9ab0-d2fd94667cd6 2023-02-13 00:04:13,002 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:04:13,002 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 00:04:13,004 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:04:13,004 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:04:13,004 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 00:04:13,004 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 00:04:13,007 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:04:13,009 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 00:04:13,009 DEBUG [RS:1;jenkins-hbase4:42551] zookeeper.ReadOnlyZKClient(139): Connect 0x3d099df2 to 127.0.0.1:56761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:13,009 DEBUG [RS:0;jenkins-hbase4:44821] zookeeper.ReadOnlyZKClient(139): Connect 0x74481286 to 127.0.0.1:56761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:13,012 DEBUG [RS:0;jenkins-hbase4:44821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a8ff27f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:13,012 DEBUG [RS:1;jenkins-hbase4:42551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33ce6423, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:13,012 DEBUG [RS:0;jenkins-hbase4:44821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eb079f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:13,012 DEBUG [RS:1;jenkins-hbase4:42551] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f1f682, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:13,020 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44821 2023-02-13 00:04:13,020 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42551 2023-02-13 00:04:13,020 INFO [RS:0;jenkins-hbase4:44821] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:04:13,021 INFO [RS:0;jenkins-hbase4:44821] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:04:13,021 INFO [RS:1;jenkins-hbase4:42551] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 00:04:13,021 INFO [RS:1;jenkins-hbase4:42551] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 00:04:13,021 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:04:13,021 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 00:04:13,021 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38801,1676246652697 with isa=jenkins-hbase4.apache.org/172.31.14.131:44821, startcode=1676246652748 2023-02-13 00:04:13,021 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38801,1676246652697 with isa=jenkins-hbase4.apache.org/172.31.14.131:42551, startcode=1676246652778 2023-02-13 00:04:13,021 DEBUG [RS:0;jenkins-hbase4:44821] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:04:13,021 DEBUG [RS:1;jenkins-hbase4:42551] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 00:04:13,023 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51907, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:04:13,023 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49199, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 00:04:13,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38801] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,025 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,025 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e 2023-02-13 00:04:13,025 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38667 2023-02-13 00:04:13,025 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:04:13,026 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e 2023-02-13 00:04:13,026 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38667 2023-02-13 00:04:13,026 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 00:04:13,027 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:13,031 DEBUG [RS:0;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,031 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44821,1676246652748] 2023-02-13 00:04:13,031 WARN [RS:0;jenkins-hbase4:44821] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:13,031 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42551,1676246652778] 2023-02-13 00:04:13,031 DEBUG [RS:1;jenkins-hbase4:42551] zookeeper.ZKUtil(162): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,031 INFO [RS:0;jenkins-hbase4:44821] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:13,031 WARN [RS:1;jenkins-hbase4:42551] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 00:04:13,031 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,031 INFO [RS:1;jenkins-hbase4:42551] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:13,031 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,037 DEBUG [RS:0;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,037 DEBUG [RS:1;jenkins-hbase4:42551] zookeeper.ZKUtil(162): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,037 DEBUG [RS:0;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,037 DEBUG [RS:1;jenkins-hbase4:42551] zookeeper.ZKUtil(162): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,038 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:04:13,038 DEBUG [RS:0;jenkins-hbase4:44821] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 00:04:13,038 INFO [RS:1;jenkins-hbase4:42551] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:04:13,038 INFO [RS:0;jenkins-hbase4:44821] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 00:04:13,039 INFO [RS:1;jenkins-hbase4:42551] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:04:13,039 INFO [RS:1;jenkins-hbase4:42551] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:04:13,039 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,039 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:04:13,043 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,044 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,044 INFO [RS:0;jenkins-hbase4:44821] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 00:04:13,044 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,044 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,044 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,045 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,045 INFO [RS:0;jenkins-hbase4:44821] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 00:04:13,045 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:13,045 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,045 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,045 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,045 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 00:04:13,045 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,045 DEBUG [RS:1;jenkins-hbase4:42551] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,046 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,047 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,047 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,047 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,049 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,050 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,050 DEBUG [RS:0;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 00:04:13,051 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,051 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,052 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,062 INFO [RS:1;jenkins-hbase4:42551] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:04:13,062 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42551,1676246652778-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,071 INFO [RS:0;jenkins-hbase4:44821] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 00:04:13,071 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44821,1676246652748-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,076 INFO [RS:1;jenkins-hbase4:42551] regionserver.Replication(203): jenkins-hbase4.apache.org,42551,1676246652778 started 2023-02-13 00:04:13,076 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42551,1676246652778, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42551, sessionid=0x1004afe00cd0002 2023-02-13 00:04:13,076 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:04:13,076 DEBUG [RS:1;jenkins-hbase4:42551] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,076 DEBUG [RS:1;jenkins-hbase4:42551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42551,1676246652778' 2023-02-13 00:04:13,076 DEBUG [RS:1;jenkins-hbase4:42551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:13,076 DEBUG [RS:1;jenkins-hbase4:42551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42551,1676246652778' 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:13,077 DEBUG [RS:1;jenkins-hbase4:42551] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:04:13,077 INFO [RS:1;jenkins-hbase4:42551] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:04:13,077 INFO [RS:1;jenkins-hbase4:42551] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:04:13,085 INFO [RS:0;jenkins-hbase4:44821] regionserver.Replication(203): jenkins-hbase4.apache.org,44821,1676246652748 started 2023-02-13 00:04:13,085 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44821,1676246652748, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44821, sessionid=0x1004afe00cd0001 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44821,1676246652748' 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44821,1676246652748' 2023-02-13 00:04:13,085 DEBUG [RS:0;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:13,086 DEBUG [RS:0;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:13,086 DEBUG [RS:0;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 00:04:13,086 INFO [RS:0;jenkins-hbase4:44821] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 00:04:13,086 INFO [RS:0;jenkins-hbase4:44821] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 00:04:13,117 DEBUG [jenkins-hbase4:38801] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 00:04:13,117 DEBUG [jenkins-hbase4:38801] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:13,118 DEBUG [jenkins-hbase4:38801] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:13,119 DEBUG [jenkins-hbase4:38801] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:13,119 DEBUG [jenkins-hbase4:38801] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:13,119 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42551,1676246652778, state=OPENING 2023-02-13 00:04:13,120 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 00:04:13,121 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:13,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42551,1676246652778}] 2023-02-13 00:04:13,122 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:04:13,277 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,277 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:04:13,278 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:04:13,281 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 00:04:13,281 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 00:04:13,282 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42551%2C1676246652778.meta, suffix=.meta, logDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,42551,1676246652778, archiveDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/oldWALs, maxLogs=32 2023-02-13 00:04:13,297 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK] 2023-02-13 00:04:13,297 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK] 2023-02-13 00:04:13,299 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,42551,1676246652778/jenkins-hbase4.apache.org%2C42551%2C1676246652778.meta.1676246653283.meta 2023-02-13 00:04:13,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK], DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK]] 2023-02-13 00:04:13,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:13,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 00:04:13,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 00:04:13,300 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 00:04:13,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 00:04:13,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:13,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 00:04:13,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 00:04:13,301 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 00:04:13,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/info 2023-02-13 00:04:13,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/info 2023-02-13 00:04:13,302 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 00:04:13,302 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:13,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 00:04:13,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:13,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/rep_barrier 2023-02-13 00:04:13,304 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 00:04:13,304 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:13,304 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 00:04:13,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/table 2023-02-13 00:04:13,305 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/table 2023-02-13 00:04:13,305 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 00:04:13,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:13,306 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740 2023-02-13 00:04:13,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740 2023-02-13 00:04:13,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 00:04:13,309 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 00:04:13,310 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67783843, jitterRate=0.010057970881462097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 00:04:13,310 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676246653300Writing region info on filesystem at 1676246653300Initializing all the Stores at 1676246653300Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246653301 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246653301Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246653301Cleaning up temporary data from old regions at 1676246653308 (+7 ms)Cleaning up detritus from prior splits at 1676246653308Running coprocessor post-open hooks at 1676246653310 (+2 ms)Region opened successfully at 1676246653310 2023-02-13 00:04:13,311 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676246653276 2023-02-13 00:04:13,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 00:04:13,315 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 00:04:13,315 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42551,1676246652778, state=OPEN 2023-02-13 00:04:13,316 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 00:04:13,316 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 00:04:13,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 00:04:13,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42551,1676246652778 in 194 msec 2023-02-13 00:04:13,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 00:04:13,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-13 00:04:13,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 393 msec 2023-02-13 00:04:13,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676246652803, completionTime=-1 2023-02-13 00:04:13,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 00:04:13,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 00:04:13,323 DEBUG [hconnection-0x15264609-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:13,324 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:13,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 00:04:13,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676246713325 2023-02-13 00:04:13,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676246773325 2023-02-13 00:04:13,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38801,1676246652697-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38801,1676246652697-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38801,1676246652697-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38801, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 00:04:13,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:13,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 00:04:13,336 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 00:04:13,336 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:04:13,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:04:13,338 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,338 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913 empty. 2023-02-13 00:04:13,339 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 00:04:13,349 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:13,350 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 259c9e66295c9aca6fbccb14db0c3913, NAME => 'hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp 2023-02-13 00:04:13,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:13,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 259c9e66295c9aca6fbccb14db0c3913, disabling compactions & flushes 2023-02-13 00:04:13,356 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. after waiting 0 ms 2023-02-13 00:04:13,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,356 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 259c9e66295c9aca6fbccb14db0c3913: Waiting for close lock at 1676246653356Disabling compacts and flushes for region at 1676246653356Disabling writes for close at 1676246653356Writing region close event to WAL at 1676246653356Closed at 1676246653356 2023-02-13 00:04:13,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:04:13,358 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246653358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246653358"}]},"ts":"1676246653358"} 2023-02-13 00:04:13,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:04:13,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:04:13,360 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246653360"}]},"ts":"1676246653360"} 2023-02-13 00:04:13,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 00:04:13,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:13,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:13,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:13,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:13,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=259c9e66295c9aca6fbccb14db0c3913, ASSIGN}] 2023-02-13 00:04:13,368 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=259c9e66295c9aca6fbccb14db0c3913, ASSIGN 2023-02-13 00:04:13,368 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=259c9e66295c9aca6fbccb14db0c3913, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42551,1676246652778; forceNewPlan=false, retain=false 2023-02-13 00:04:13,519 INFO [jenkins-hbase4:38801] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:04:13,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=259c9e66295c9aca6fbccb14db0c3913, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246653519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246653519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246653519"}]},"ts":"1676246653519"} 2023-02-13 00:04:13,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 259c9e66295c9aca6fbccb14db0c3913, server=jenkins-hbase4.apache.org,42551,1676246652778}] 2023-02-13 00:04:13,675 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,676 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42551%2C1676246652778, suffix=, logDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,42551,1676246652778, archiveDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/oldWALs, maxLogs=32 2023-02-13 00:04:13,690 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK] 2023-02-13 00:04:13,690 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK] 2023-02-13 00:04:13,691 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,42551,1676246652778/jenkins-hbase4.apache.org%2C42551%2C1676246652778.1676246653676 2023-02-13 00:04:13,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK], DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK]] 2023-02-13 00:04:13,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 259c9e66295c9aca6fbccb14db0c3913, NAME => 'hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:13,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:13,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,693 INFO [StoreOpener-259c9e66295c9aca6fbccb14db0c3913-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,694 DEBUG [StoreOpener-259c9e66295c9aca6fbccb14db0c3913-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/info 2023-02-13 00:04:13,694 DEBUG [StoreOpener-259c9e66295c9aca6fbccb14db0c3913-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/info 2023-02-13 00:04:13,695 INFO [StoreOpener-259c9e66295c9aca6fbccb14db0c3913-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 259c9e66295c9aca6fbccb14db0c3913 columnFamilyName info 2023-02-13 00:04:13,695 INFO [StoreOpener-259c9e66295c9aca6fbccb14db0c3913-1] regionserver.HStore(310): Store=259c9e66295c9aca6fbccb14db0c3913/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:13,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:13,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:13,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 259c9e66295c9aca6fbccb14db0c3913; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64539716, jitterRate=-0.03828328847885132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 00:04:13,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 259c9e66295c9aca6fbccb14db0c3913: Running coprocessor pre-open hook at 1676246653692Writing region info on filesystem at 1676246653692Initializing all the Stores at 1676246653693 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676246653693Cleaning up temporary data from old regions at 1676246653697 (+4 ms)Cleaning up detritus from prior splits at 1676246653697Running coprocessor post-open hooks at 1676246653700 (+3 ms)Region opened successfully at 1676246653700 2023-02-13 00:04:13,701 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913., pid=6, masterSystemTime=1676246653672 2023-02-13 00:04:13,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,702 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:13,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=259c9e66295c9aca6fbccb14db0c3913, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:13,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676246653702"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246653702"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246653702"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246653702"}]},"ts":"1676246653702"} 2023-02-13 00:04:13,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 00:04:13,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 259c9e66295c9aca6fbccb14db0c3913, server=jenkins-hbase4.apache.org,42551,1676246652778 in 183 msec 2023-02-13 00:04:13,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 00:04:13,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=259c9e66295c9aca6fbccb14db0c3913, ASSIGN in 341 msec 2023-02-13 00:04:13,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:04:13,707 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246653707"}]},"ts":"1676246653707"} 2023-02-13 00:04:13,708 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 00:04:13,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:04:13,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 377 msec 2023-02-13 00:04:13,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 00:04:13,737 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:13,737 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:13,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 00:04:13,746 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:13,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-13 00:04:13,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 00:04:13,758 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 00:04:13,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 00:04:13,765 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 00:04:13,767 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 00:04:13,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.957sec 2023-02-13 00:04:13,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 00:04:13,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 00:04:13,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 00:04:13,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38801,1676246652697-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 00:04:13,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38801,1676246652697-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 00:04:13,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 00:04:13,802 DEBUG [Listener at localhost/38351] zookeeper.ReadOnlyZKClient(139): Connect 0x262aec8b to 127.0.0.1:56761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:13,805 DEBUG [Listener at localhost/38351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74dea0fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:13,807 DEBUG [hconnection-0x1ca8bf52-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:13,808 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42918, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:13,809 INFO [Listener at localhost/38351] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:13,809 DEBUG [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 00:04:13,812 DEBUG [Listener at localhost/38351] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 00:04:13,813 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56568, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 00:04:13,813 INFO [Listener at localhost/38351] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 00:04:13,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 00:04:13,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 00:04:13,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:56568 deadline: 1676246713814, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 00:04:13,814 INFO [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 00:04:13,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 00:04:13,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 00:04:13,818 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 00:04:13,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 00:04:13,819 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 00:04:13,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:13,820 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:13,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a empty. 2023-02-13 00:04:13,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:13,821 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 00:04:13,828 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 00:04:13,829 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2ca1b5ab6ae65e496dff0921e8e3549a, NAME => 'testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp 2023-02-13 00:04:13,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:13,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2ca1b5ab6ae65e496dff0921e8e3549a, disabling compactions & flushes 2023-02-13 00:04:13,835 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:13,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:13,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. after waiting 0 ms 2023-02-13 00:04:13,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:13,835 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:13,835 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2ca1b5ab6ae65e496dff0921e8e3549a: Waiting for close lock at 1676246653835Disabling compacts and flushes for region at 1676246653835Disabling writes for close at 1676246653835Writing region close event to WAL at 1676246653835Closed at 1676246653835 2023-02-13 00:04:13,837 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 00:04:13,837 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676246653837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246653837"}]},"ts":"1676246653837"} 2023-02-13 00:04:13,839 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 00:04:13,839 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 00:04:13,839 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246653839"}]},"ts":"1676246653839"} 2023-02-13 00:04:13,840 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 00:04:13,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 00:04:13,845 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 00:04:13,845 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 00:04:13,845 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 00:04:13,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, ASSIGN}] 2023-02-13 00:04:13,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, ASSIGN 2023-02-13 00:04:13,849 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44821,1676246652748; forceNewPlan=false, retain=false 2023-02-13 00:04:13,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:13,999 INFO [jenkins-hbase4:38801] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 00:04:14,000 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2ca1b5ab6ae65e496dff0921e8e3549a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,000 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676246654000"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246654000"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246654000"}]},"ts":"1676246654000"} 2023-02-13 00:04:14,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2ca1b5ab6ae65e496dff0921e8e3549a, server=jenkins-hbase4.apache.org,44821,1676246652748}] 2023-02-13 00:04:14,087 INFO [RS:0;jenkins-hbase4:44821] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44821%2C1676246652748, suffix=, logDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,44821,1676246652748, archiveDir=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/oldWALs, maxLogs=32 2023-02-13 00:04:14,102 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK] 2023-02-13 00:04:14,103 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK] 2023-02-13 00:04:14,104 INFO [RS:0;jenkins-hbase4:44821] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/WALs/jenkins-hbase4.apache.org,44821,1676246652748/jenkins-hbase4.apache.org%2C44821%2C1676246652748.1676246654088 2023-02-13 00:04:14,104 DEBUG [RS:0;jenkins-hbase4:44821] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39187,DS-d9dad3b4-25a2-4c8a-9668-22b9c2582820,DISK], DatanodeInfoWithStorage[127.0.0.1:38737,DS-b44ed607-3853-4ec5-bb04-914d5a52a072,DISK]] 2023-02-13 00:04:14,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:14,154 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,154 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 00:04:14,156 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 00:04:14,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:14,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2ca1b5ab6ae65e496dff0921e8e3549a, NAME => 'testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 00:04:14,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:14,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,161 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,162 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1 2023-02-13 00:04:14,162 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1 2023-02-13 00:04:14,162 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca1b5ab6ae65e496dff0921e8e3549a columnFamilyName f1 2023-02-13 00:04:14,163 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(310): Store=2ca1b5ab6ae65e496dff0921e8e3549a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:14,163 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,164 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2 2023-02-13 00:04:14,164 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2 2023-02-13 00:04:14,164 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca1b5ab6ae65e496dff0921e8e3549a columnFamilyName f2 2023-02-13 00:04:14,164 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(310): Store=2ca1b5ab6ae65e496dff0921e8e3549a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:14,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:04:14,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:14,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 00:04:14,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2ca1b5ab6ae65e496dff0921e8e3549a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62276474, jitterRate=-0.07200822234153748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:04:14,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2ca1b5ab6ae65e496dff0921e8e3549a: Running coprocessor pre-open hook at 1676246654159Writing region info on filesystem at 1676246654159Initializing all the Stores at 1676246654160 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246654160Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246654160Cleaning up temporary data from old regions at 1676246654166 (+6 ms)Cleaning up detritus from prior splits at 1676246654166Running coprocessor post-open hooks at 1676246654173 (+7 ms)Region opened successfully at 1676246654173 2023-02-13 00:04:14,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a., pid=12, masterSystemTime=1676246654154 2023-02-13 00:04:14,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:14,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:14,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2ca1b5ab6ae65e496dff0921e8e3549a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,179 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676246654179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676246654179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676246654179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676246654179"}]},"ts":"1676246654179"} 2023-02-13 00:04:14,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 00:04:14,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2ca1b5ab6ae65e496dff0921e8e3549a, server=jenkins-hbase4.apache.org,44821,1676246652748 in 179 msec 2023-02-13 00:04:14,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 00:04:14,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, ASSIGN in 337 msec 2023-02-13 00:04:14,184 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 00:04:14,184 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246654184"}]},"ts":"1676246654184"} 2023-02-13 00:04:14,185 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 00:04:14,187 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 00:04:14,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 371 msec 2023-02-13 00:04:14,272 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 00:04:14,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 00:04:14,424 INFO [Listener at localhost/38351] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 00:04:14,424 DEBUG [Listener at localhost/38351] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 00:04:14,425 INFO [Listener at localhost/38351] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:04:14,427 INFO [Listener at localhost/38351] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 00:04:14,427 INFO [Listener at localhost/38351] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 00:04:14,427 INFO [Listener at localhost/38351] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 00:04:14,427 INFO [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 00:04:14,442 DEBUG [hconnection-0x1ca8bf52-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:14,454 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:14,461 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:14,559 INFO [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 00:04:14,559 INFO [Listener at localhost/38351] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 00:04:14,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:04:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676246654560 (current time:1676246654560). 2023-02-13 00:04:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 00:04:14,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] zookeeper.ReadOnlyZKClient(139): Connect 0x6ba96649 to 127.0.0.1:56761 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 00:04:14,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f6a5398, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 00:04:14,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 00:04:14,566 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42932, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 00:04:14,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ba96649 to 127.0.0.1:56761 2023-02-13 00:04:14,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:14,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 00:04:14,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:04:14,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:04:14,570 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:04:14,571 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676247254571 2023-02-13 00:04:14,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 00:04:14,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 00:04:14,571 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 00:04:14,571 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 00:04:14,571 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 00:04:14,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:04:14,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 3 msec 2023-02-13 00:04:14,573 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:04:14,574 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676247254574 2023-02-13 00:04:14,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-13 00:04:14,581 INFO [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-13 00:04:14,582 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:14,583 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-13 00:04:14,583 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 00:04:14,583 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,583 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,590 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:14,590 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:14,590 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:14,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:14,591 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,591 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 00:04:14,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 00:04:14,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 00:04:14,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 00:04:14,592 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 00:04:14,592 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:14,592 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 00:04:14,593 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 00:04:14,593 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 00:04:14,593 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 00:04:14,593 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1676246652748' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 00:04:14,595 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 00:04:14,596 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 00:04:14,596 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42551,1676246652778' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 00:04:14,597 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:14,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,597 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 00:04:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:14,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1676246652748' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-13 00:04:14,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b70978b[Count = 0] remaining members to acquire global barrier 2023-02-13 00:04:14,599 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 00:04:14,599 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,600 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 00:04:14,600 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 00:04:14,600 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 00:04:14,600 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,600 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:04:14,600 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42551,1676246652778' in zk 2023-02-13 00:04:14,600 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 00:04:14,601 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 00:04:14,601 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:14,601 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. started... 2023-02-13 00:04:14,601 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2ca1b5ab6ae65e496dff0921e8e3549a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 00:04:14,602 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 00:04:14,602 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:14,602 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 00:04:14,616 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f1/164bbe4afd8e47de8bc40fbe85edeb64 2023-02-13 00:04:14,637 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f2/33e35240902e4a74a6fce4027607fa81 2023-02-13 00:04:14,641 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f1/164bbe4afd8e47de8bc40fbe85edeb64 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/164bbe4afd8e47de8bc40fbe85edeb64 2023-02-13 00:04:14,645 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/164bbe4afd8e47de8bc40fbe85edeb64, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:04:14,645 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f2/33e35240902e4a74a6fce4027607fa81 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/33e35240902e4a74a6fce4027607fa81 2023-02-13 00:04:14,649 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/33e35240902e4a74a6fce4027607fa81, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 00:04:14,649 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2ca1b5ab6ae65e496dff0921e8e3549a in 48ms, sequenceid=5, compaction requested=false 2023-02-13 00:04:14,649 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2ca1b5ab6ae65e496dff0921e8e3549a: 2023-02-13 00:04:14,650 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-13 00:04:14,650 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 00:04:14,650 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/164bbe4afd8e47de8bc40fbe85edeb64] hfiles 2023-02-13 00:04:14,650 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/164bbe4afd8e47de8bc40fbe85edeb64 for snapshot=testWithMapReduceSingleRegion 2023-02-13 00:04:14,650 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/33e35240902e4a74a6fce4027607fa81] hfiles 2023-02-13 00:04:14,650 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/33e35240902e4a74a6fce4027607fa81 for snapshot=testWithMapReduceSingleRegion 2023-02-13 00:04:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. completed. 2023-02-13 00:04:14,663 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 00:04:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 00:04:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 00:04:14,663 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44821,1676246652748' in zk 2023-02-13 00:04:14,666 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 00:04:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:14,666 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 00:04:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 00:04:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:14,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 00:04:14,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,44821,1676246652748': 2023-02-13 00:04:14,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1676246652748' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 00:04:14,669 INFO [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-13 00:04:14,669 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:04:14,669 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:04:14,669 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-13 00:04:14,669 INFO [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 00:04:14,671 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 00:04:14,671 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:14,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:14,671 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,672 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 00:04:14,672 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:14,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:04:14,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 00:04:14,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 00:04:14,673 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 00:04:14,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,674 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:14,674 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 00:04:14,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:14,679 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 00:04:14,679 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-13 00:04:14,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:14,680 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 00:04:14,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-13 00:04:14,680 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:14,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 00:04:14,679 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 00:04:14,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 00:04:14,680 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:14,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:14,680 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:14,680 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 00:04:14,680 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 00:04:14,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 00:04:14,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 00:04:14,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 00:04:14,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-13 00:04:14,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-13 00:04:14,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 00:04:14,709 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 00:04:14,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676246654571Consolidate snapshot: testWithMapReduceSingleRegion at 1676246654679 (+108 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676246654680 (+1 ms)Writing data manifest for testWithMapReduceSingleRegion at 1676246654682 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676246654688 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676246654709 (+21 ms) 2023-02-13 00:04:14,710 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 00:04:14,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 139 msec 2023-02-13 00:04:14,873 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 00:04:14,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 00:04:14,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 00:04:14,874 INFO [Listener at localhost/38351] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 00:04:14,878 INFO [Listener at localhost/38351] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 00:04:14,882 INFO [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 00:04:14,910 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,019 INFO [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 00:04:15,024 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 00:04:15,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 00:04:15,028 INFO [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 00:04:15,028 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:15,028 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 00:04:15,028 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 00:04:15,029 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,029 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,031 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:15,031 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:15,031 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:15,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:15,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:15,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:15,032 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,032 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 00:04:15,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 00:04:15,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 00:04:15,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 00:04:15,034 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42551,1676246652778' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 00:04:15,036 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,036 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 00:04:15,036 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 00:04:15,036 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,036 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,036 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:15,036 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. started... 2023-02-13 00:04:15,036 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2ca1b5ab6ae65e496dff0921e8e3549a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 00:04:15,057 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f1/ad750a795bcc41c0b6b5472387538774 2023-02-13 00:04:15,079 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f2/2a376ae17c0b417281832a6056dd9a75 2023-02-13 00:04:15,085 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f1/ad750a795bcc41c0b6b5472387538774 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/ad750a795bcc41c0b6b5472387538774 2023-02-13 00:04:15,089 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/ad750a795bcc41c0b6b5472387538774, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:04:15,090 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/.tmp/f2/2a376ae17c0b417281832a6056dd9a75 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/2a376ae17c0b417281832a6056dd9a75 2023-02-13 00:04:15,094 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/2a376ae17c0b417281832a6056dd9a75, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 00:04:15,095 INFO [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2ca1b5ab6ae65e496dff0921e8e3549a in 59ms, sequenceid=9, compaction requested=false 2023-02-13 00:04:15,095 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2ca1b5ab6ae65e496dff0921e8e3549a: 2023-02-13 00:04:15,095 DEBUG [rs(jenkins-hbase4.apache.org,44821,1676246652748)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,095 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 00:04:15,095 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 00:04:15,095 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,095 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 00:04:15,095 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1676246652748' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 00:04:15,097 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,097 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:15,097 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:15,097 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 00:04:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:04:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:15,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1676246652748' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 00:04:15,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f4f1c3d[Count = 0] remaining members to acquire global barrier 2023-02-13 00:04:15,099 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 00:04:15,099 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,100 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,100 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 00:04:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 00:04:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 00:04:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42551,1676246652778' in zk 2023-02-13 00:04:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 00:04:15,101 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,101 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 00:04:15,101 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44821,1676246652748' in zk 2023-02-13 00:04:15,103 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 00:04:15,103 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,42551,1676246652778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 00:04:15,104 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 00:04:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:15,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:15,104 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:15,105 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1676246652748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 00:04:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:15,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:04:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:04:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44821,1676246652748': 2023-02-13 00:04:15,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1676246652748' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 00:04:15,107 INFO [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 00:04:15,107 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 00:04:15,107 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 00:04:15,107 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 00:04:15,107 INFO [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 00:04:15,109 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 00:04:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 00:04:15,109 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,109 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 00:04:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:04:15,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,110 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:04:15,111 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 00:04:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 00:04:15,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,112 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,112 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,115 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:15,115 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 00:04:15,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 00:04:15,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 00:04:15,114 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 00:04:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:15,115 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 00:04:15,115 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 00:04:15,115 DEBUG [(jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 00:04:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 00:04:15,115 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 00:04:15,115 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 00:04:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 00:04:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 00:04:15,215 DEBUG [Listener at localhost/38351] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 00:04:15,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 00:04:15,315 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/hadoop-6129764633946195791.jar 2023-02-13 00:04:15,319 INFO [Listener at localhost/38351] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676246654560 type: FLUSH version: 2 ttl: 0 2023-02-13 00:04:15,319 DEBUG [Listener at localhost/38351] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8/data/default/testWithMapReduce 2023-02-13 00:04:15,320 INFO [Listener at localhost/38351] snapshot.RestoreSnapshotHelper(239): region to add: 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:15,320 INFO [Listener at localhost/38351] snapshot.RestoreSnapshotHelper(585): clone region=2ca1b5ab6ae65e496dff0921e8e3549a as 2ca1b5ab6ae65e496dff0921e8e3549a in snapshot testWithMapReduceSingleRegion 2023-02-13 00:04:15,321 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2ca1b5ab6ae65e496dff0921e8e3549a, NAME => 'testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8 2023-02-13 00:04:15,326 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:15,326 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 164bbe4afd8e47de8bc40fbe85edeb64 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 00:04:15,328 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33e35240902e4a74a6fce4027607fa81 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 00:04:15,329 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2ca1b5ab6ae65e496dff0921e8e3549a, disabling compactions & flushes 2023-02-13 00:04:15,329 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,329 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,329 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. after waiting 0 ms 2023-02-13 00:04:15,330 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,330 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,330 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2ca1b5ab6ae65e496dff0921e8e3549a: Waiting for close lock at 1676246655329Disabling compacts and flushes for region at 1676246655329Disabling writes for close at 1676246655330 (+1 ms)Writing region close event to WAL at 1676246655330Closed at 1676246655330 2023-02-13 00:04:15,330 INFO [Listener at localhost/38351] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676246654560 type: FLUSH version: 2 ttl: 0 2023-02-13 00:04:15,330 DEBUG [Listener at localhost/38351] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8 2023-02-13 00:04:15,330 DEBUG [Listener at localhost/38351] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8 2023-02-13 00:04:15,330 DEBUG [Listener at localhost/38351] util.CommonFSUtils(699): |-data/ 2023-02-13 00:04:15,331 DEBUG [Listener at localhost/38351] util.CommonFSUtils(699): |----default/ 2023-02-13 00:04:15,331 DEBUG [Listener at localhost/38351] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 00:04:15,331 DEBUG [Listener at localhost/38351] util.CommonFSUtils(699): |----------2ca1b5ab6ae65e496dff0921e8e3549a/ 2023-02-13 00:04:15,331 DEBUG [Listener at localhost/38351] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 00:04:15,332 DEBUG [Listener at localhost/38351] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 00:04:15,332 DEBUG [Listener at localhost/38351] util.CommonFSUtils(702): |----------------testWithMapReduce=2ca1b5ab6ae65e496dff0921e8e3549a-164bbe4afd8e47de8bc40fbe85edeb64 2023-02-13 00:04:15,332 DEBUG [Listener at localhost/38351] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 00:04:15,332 DEBUG [Listener at localhost/38351] util.CommonFSUtils(702): |----------------testWithMapReduce=2ca1b5ab6ae65e496dff0921e8e3549a-33e35240902e4a74a6fce4027607fa81 2023-02-13 00:04:15,333 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,333 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,334 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,334 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,335 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,335 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,336 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,412 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/hadoop-8451013114429721106.jar 2023-02-13 00:04:15,412 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,413 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,413 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,413 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,414 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,414 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,414 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 00:04:15,414 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 00:04:15,415 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 00:04:15,415 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 00:04:15,415 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 00:04:15,416 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 00:04:15,416 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 00:04:15,417 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 00:04:15,417 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 00:04:15,417 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 00:04:15,418 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 00:04:15,418 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:04:15,418 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:04:15,418 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 00:04:15,419 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 00:04:15,485 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/hadoop-3129563645984913170.jar 2023-02-13 00:04:15,485 DEBUG [Listener at localhost/38351] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 00:04:15,491 WARN [Listener at localhost/38351] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 00:04:15,523 INFO [Listener at localhost/38351] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 00:04:15,602 WARN [Listener at localhost/38351] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/mapreduce.cluster.local.dir/1676246655565/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 00:04:15,602 WARN [Listener at localhost/38351] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/mapreduce.cluster.local.dir/1676246655565/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 00:04:15,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 00:04:15,641 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 00:04:15,641 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 00:04:15,643 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:15,644 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1 2023-02-13 00:04:15,644 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca1b5ab6ae65e496dff0921e8e3549a columnFamilyName f1 2023-02-13 00:04:15,648 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(539): loaded hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/testWithMapReduce=2ca1b5ab6ae65e496dff0921e8e3549a-164bbe4afd8e47de8bc40fbe85edeb64 2023-02-13 00:04:15,648 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(310): Store=2ca1b5ab6ae65e496dff0921e8e3549a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:15,648 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:15,649 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2 2023-02-13 00:04:15,649 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ca1b5ab6ae65e496dff0921e8e3549a columnFamilyName f2 2023-02-13 00:04:15,655 DEBUG [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(539): loaded hdfs://localhost:38667/user/jenkins/test-data/d3d35544-6309-f7de-91cd-fc0f748d3c38/testWithMapReduceSingleRegion/927204e8-c7b3-450a-b42e-9b8bd0cf49c8/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/testWithMapReduce=2ca1b5ab6ae65e496dff0921e8e3549a-33e35240902e4a74a6fce4027607fa81 2023-02-13 00:04:15,656 INFO [StoreOpener-2ca1b5ab6ae65e496dff0921e8e3549a-1] regionserver.HStore(310): Store=2ca1b5ab6ae65e496dff0921e8e3549a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 00:04:15,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 00:04:15,656 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2ca1b5ab6ae65e496dff0921e8e3549a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69167490, jitterRate=0.030675917863845825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 00:04:15,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2ca1b5ab6ae65e496dff0921e8e3549a: Writing region info on filesystem at 1676246655641Initializing all the Stores at 1676246655642 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246655642Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676246655642Region opened successfully at 1676246655656 (+14 ms) 2023-02-13 00:04:15,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2ca1b5ab6ae65e496dff0921e8e3549a, disabling compactions & flushes 2023-02-13 00:04:15,788 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. after waiting 0 ms 2023-02-13 00:04:15,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,789 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:15,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2ca1b5ab6ae65e496dff0921e8e3549a: Waiting for close lock at 1676246655788Disabling compacts and flushes for region at 1676246655788Disabling writes for close at 1676246655788Writing region close event to WAL at 1676246655789 (+1 ms)Closed at 1676246655789 2023-02-13 00:04:16,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-13 00:04:16,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-13 00:04:16,648 INFO [Listener at localhost/38351] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 00:04:16,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 00:04:16,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:16,652 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246656651"}]},"ts":"1676246656651"} 2023-02-13 00:04:16,653 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 00:04:16,655 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 00:04:16,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, UNASSIGN}] 2023-02-13 00:04:16,657 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, UNASSIGN 2023-02-13 00:04:16,657 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2ca1b5ab6ae65e496dff0921e8e3549a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:16,657 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676246656657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676246656657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676246656657"}]},"ts":"1676246656657"} 2023-02-13 00:04:16,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2ca1b5ab6ae65e496dff0921e8e3549a, server=jenkins-hbase4.apache.org,44821,1676246652748}] 2023-02-13 00:04:16,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:16,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:16,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2ca1b5ab6ae65e496dff0921e8e3549a, disabling compactions & flushes 2023-02-13 00:04:16,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:16,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:16,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. after waiting 0 ms 2023-02-13 00:04:16,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:16,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 00:04:16,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a. 2023-02-13 00:04:16,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2ca1b5ab6ae65e496dff0921e8e3549a: Waiting for close lock at 1676246656811Running coprocessor pre-close hooks at 1676246656811Disabling compacts and flushes for region at 1676246656811Disabling writes for close at 1676246656811Writing region close event to WAL at 1676246656812 (+1 ms)Running coprocessor post-close hooks at 1676246656817 (+5 ms)Closed at 1676246656818 (+1 ms) 2023-02-13 00:04:16,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:16,820 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2ca1b5ab6ae65e496dff0921e8e3549a, regionState=CLOSED 2023-02-13 00:04:16,820 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676246656820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676246656820"}]},"ts":"1676246656820"} 2023-02-13 00:04:16,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 00:04:16,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2ca1b5ab6ae65e496dff0921e8e3549a, server=jenkins-hbase4.apache.org,44821,1676246652748 in 163 msec 2023-02-13 00:04:16,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 00:04:16,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2ca1b5ab6ae65e496dff0921e8e3549a, UNASSIGN in 166 msec 2023-02-13 00:04:16,824 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676246656824"}]},"ts":"1676246656824"} 2023-02-13 00:04:16,825 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 00:04:16,827 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 00:04:16,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 178 msec 2023-02-13 00:04:16,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 00:04:16,954 INFO [Listener at localhost/38351] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-13 00:04:16,955 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 00:04:16,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,958 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:04:16,961 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:16,962 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1, FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2, FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/recovered.edits] 2023-02-13 00:04:16,965 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/164bbe4afd8e47de8bc40fbe85edeb64 to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/archive/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/164bbe4afd8e47de8bc40fbe85edeb64 2023-02-13 00:04:16,966 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/ad750a795bcc41c0b6b5472387538774 to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/archive/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f1/ad750a795bcc41c0b6b5472387538774 2023-02-13 00:04:16,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/2a376ae17c0b417281832a6056dd9a75 to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/archive/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/2a376ae17c0b417281832a6056dd9a75 2023-02-13 00:04:16,969 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/33e35240902e4a74a6fce4027607fa81 to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/archive/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/f2/33e35240902e4a74a6fce4027607fa81 2023-02-13 00:04:16,971 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/recovered.edits/12.seqid to hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/archive/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a/recovered.edits/12.seqid 2023-02-13 00:04:16,971 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/.tmp/data/default/testWithMapReduce/2ca1b5ab6ae65e496dff0921e8e3549a 2023-02-13 00:04:16,971 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 00:04:16,973 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,975 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-13 00:04:16,976 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 00:04:16,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 00:04:16,977 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676246656977"}]},"ts":"9223372036854775807"} 2023-02-13 00:04:16,978 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 00:04:16,978 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2ca1b5ab6ae65e496dff0921e8e3549a, NAME => 'testWithMapReduce,,1676246653816.2ca1b5ab6ae65e496dff0921e8e3549a.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 00:04:16,978 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 00:04:16,978 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676246656978"}]},"ts":"9223372036854775807"} 2023-02-13 00:04:16,979 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 00:04:16,981 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 00:04:16,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 26 msec 2023-02-13 00:04:17,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38801] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 00:04:17,060 INFO [Listener at localhost/38351] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-13 00:04:17,060 INFO [Listener at localhost/38351] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 00:04:17,060 INFO [Listener at localhost/38351] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 00:04:17,060 DEBUG [Listener at localhost/38351] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x262aec8b to 127.0.0.1:56761 2023-02-13 00:04:17,060 DEBUG [Listener at localhost/38351] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,060 DEBUG [Listener at localhost/38351] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 00:04:17,061 DEBUG [Listener at localhost/38351] util.JVMClusterUtil(257): Found active master hash=1598562552, stopped=false 2023-02-13 00:04:17,061 INFO [Listener at localhost/38351] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:17,063 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:17,063 INFO [Listener at localhost/38351] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 00:04:17,063 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:17,063 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:17,063 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 00:04:17,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:17,065 DEBUG [Listener at localhost/38351] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38c88518 to 127.0.0.1:56761 2023-02-13 00:04:17,065 DEBUG [Listener at localhost/38351] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:17,065 INFO [Listener at localhost/38351] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44821,1676246652748' ***** 2023-02-13 00:04:17,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 00:04:17,065 INFO [Listener at localhost/38351] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:04:17,066 INFO [Listener at localhost/38351] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42551,1676246652778' ***** 2023-02-13 00:04:17,066 INFO [Listener at localhost/38351] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 00:04:17,066 INFO [RS:0;jenkins-hbase4:44821] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:04:17,066 INFO [RS:0;jenkins-hbase4:44821] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:04:17,066 INFO [RS:1;jenkins-hbase4:42551] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 00:04:17,066 INFO [RS:0;jenkins-hbase4:44821] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:04:17,066 INFO [RS:1;jenkins-hbase4:42551] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 00:04:17,066 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:04:17,066 INFO [RS:1;jenkins-hbase4:42551] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 00:04:17,066 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:17,066 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 00:04:17,067 DEBUG [RS:0;jenkins-hbase4:44821] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74481286 to 127.0.0.1:56761 2023-02-13 00:04:17,067 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(3304): Received CLOSE for 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:17,068 DEBUG [RS:0;jenkins-hbase4:44821] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,068 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44821,1676246652748; all regions closed. 2023-02-13 00:04:17,068 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:17,068 DEBUG [RS:1;jenkins-hbase4:42551] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d099df2 to 127.0.0.1:56761 2023-02-13 00:04:17,068 DEBUG [RS:1;jenkins-hbase4:42551] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 259c9e66295c9aca6fbccb14db0c3913, disabling compactions & flushes 2023-02-13 00:04:17,068 INFO [RS:1;jenkins-hbase4:42551] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:04:17,069 INFO [RS:1;jenkins-hbase4:42551] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:04:17,069 INFO [RS:1;jenkins-hbase4:42551] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:04:17,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:17,069 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. after waiting 0 ms 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:17,069 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 00:04:17,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 259c9e66295c9aca6fbccb14db0c3913 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 00:04:17,069 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1479): Online Regions={259c9e66295c9aca6fbccb14db0c3913=hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913., 1588230740=hbase:meta,,1.1588230740} 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 00:04:17,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 00:04:17,069 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1505): Waiting on 1588230740, 259c9e66295c9aca6fbccb14db0c3913 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 00:04:17,069 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 00:04:17,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-13 00:04:17,073 DEBUG [RS:0;jenkins-hbase4:44821] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/oldWALs 2023-02-13 00:04:17,073 INFO [RS:0;jenkins-hbase4:44821] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44821%2C1676246652748:(num 1676246654088) 2023-02-13 00:04:17,073 DEBUG [RS:0;jenkins-hbase4:44821] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,073 INFO [RS:0;jenkins-hbase4:44821] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:17,073 INFO [RS:0;jenkins-hbase4:44821] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:17,073 INFO [RS:0;jenkins-hbase4:44821] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 00:04:17,073 INFO [RS:0;jenkins-hbase4:44821] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 00:04:17,073 INFO [RS:0;jenkins-hbase4:44821] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 00:04:17,073 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:17,074 INFO [RS:0;jenkins-hbase4:44821] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44821 2023-02-13 00:04:17,077 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:17,077 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44821,1676246652748 2023-02-13 00:04:17,077 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:17,077 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:17,077 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:17,077 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56ce6309 rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,079 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44821,1676246652748] 2023-02-13 00:04:17,079 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44821,1676246652748; numProcessing=1 2023-02-13 00:04:17,080 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44821,1676246652748 already deleted, retry=false 2023-02-13 00:04:17,080 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44821,1676246652748 expired; onlineServers=1 2023-02-13 00:04:17,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/.tmp/info/a423b881078e434db9271a48efb93e86 2023-02-13 00:04:17,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/.tmp/info/a423b881078e434db9271a48efb93e86 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/info/a423b881078e434db9271a48efb93e86 2023-02-13 00:04:17,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/info/a423b881078e434db9271a48efb93e86, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 00:04:17,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 259c9e66295c9aca6fbccb14db0c3913 in 20ms, sequenceid=6, compaction requested=false 2023-02-13 00:04:17,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/namespace/259c9e66295c9aca6fbccb14db0c3913/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 00:04:17,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:17,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 259c9e66295c9aca6fbccb14db0c3913: Waiting for close lock at 1676246657068Running coprocessor pre-close hooks at 1676246657068Disabling compacts and flushes for region at 1676246657068Disabling writes for close at 1676246657069 (+1 ms)Obtaining lock to block concurrent updates at 1676246657069Preparing flush snapshotting stores in 259c9e66295c9aca6fbccb14db0c3913 at 1676246657069Finished memstore snapshotting hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676246657069Flushing stores of hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. at 1676246657070 (+1 ms)Flushing 259c9e66295c9aca6fbccb14db0c3913/info: creating writer at 1676246657070Flushing 259c9e66295c9aca6fbccb14db0c3913/info: appending metadata at 1676246657073 (+3 ms)Flushing 259c9e66295c9aca6fbccb14db0c3913/info: closing flushed file at 1676246657073Flushing 259c9e66295c9aca6fbccb14db0c3913/info: reopening flushed file at 1676246657085 (+12 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 259c9e66295c9aca6fbccb14db0c3913 in 20ms, sequenceid=6, compaction requested=false at 1676246657089 (+4 ms)Writing region close event to WAL at 1676246657092 (+3 ms)Running coprocessor post-close hooks at 1676246657094 (+2 ms)Closed at 1676246657095 (+1 ms) 2023-02-13 00:04:17,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676246653334.259c9e66295c9aca6fbccb14db0c3913. 2023-02-13 00:04:17,110 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:17,151 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:17,262 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:17,262 INFO [RS:0;jenkins-hbase4:44821] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44821,1676246652748; zookeeper connection closed. 2023-02-13 00:04:17,262 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35d17f2 rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,262 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x1004afe00cd0001, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:17,262 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7beadacb rejected from java.util.concurrent.ThreadPoolExecutor@52f1ed08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,262 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@699c0e87] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@699c0e87 2023-02-13 00:04:17,269 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:04:17,469 DEBUG [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 00:04:17,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/.tmp/info/c86f232fe92b44c7b2ba204c8747b5ff 2023-02-13 00:04:17,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c86f232fe92b44c7b2ba204c8747b5ff 2023-02-13 00:04:17,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/.tmp/rep_barrier/9781a2dc53d2411bbc9959be0bc57c09 2023-02-13 00:04:17,494 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9781a2dc53d2411bbc9959be0bc57c09 2023-02-13 00:04:17,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/.tmp/table/1eaf28781c12476ab6845db4dd293a2e 2023-02-13 00:04:17,504 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1eaf28781c12476ab6845db4dd293a2e 2023-02-13 00:04:17,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/.tmp/info/c86f232fe92b44c7b2ba204c8747b5ff as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/info/c86f232fe92b44c7b2ba204c8747b5ff 2023-02-13 00:04:17,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c86f232fe92b44c7b2ba204c8747b5ff 2023-02-13 00:04:17,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/info/c86f232fe92b44c7b2ba204c8747b5ff, entries=12, sequenceid=21, filesize=6.2 K 2023-02-13 00:04:17,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/.tmp/rep_barrier/9781a2dc53d2411bbc9959be0bc57c09 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/rep_barrier/9781a2dc53d2411bbc9959be0bc57c09 2023-02-13 00:04:17,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9781a2dc53d2411bbc9959be0bc57c09 2023-02-13 00:04:17,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/rep_barrier/9781a2dc53d2411bbc9959be0bc57c09, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 00:04:17,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/.tmp/table/1eaf28781c12476ab6845db4dd293a2e as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/table/1eaf28781c12476ab6845db4dd293a2e 2023-02-13 00:04:17,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1eaf28781c12476ab6845db4dd293a2e 2023-02-13 00:04:17,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/table/1eaf28781c12476ab6845db4dd293a2e, entries=4, sequenceid=21, filesize=5.0 K 2023-02-13 00:04:17,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 448ms, sequenceid=21, compaction requested=false 2023-02-13 00:04:17,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 00:04:17,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 00:04:17,522 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:17,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676246657069Running coprocessor pre-close hooks at 1676246657069Disabling compacts and flushes for region at 1676246657069Disabling writes for close at 1676246657069Obtaining lock to block concurrent updates at 1676246657069Preparing flush snapshotting stores in 1588230740 at 1676246657069Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676246657070 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676246657071 (+1 ms)Flushing 1588230740/info: creating writer at 1676246657071Flushing 1588230740/info: appending metadata at 1676246657073 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676246657073Flushing 1588230740/rep_barrier: creating writer at 1676246657485 (+412 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676246657487 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676246657487Flushing 1588230740/table: creating writer at 1676246657494 (+7 ms)Flushing 1588230740/table: appending metadata at 1676246657496 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676246657496Flushing 1588230740/info: reopening flushed file at 1676246657506 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676246657510 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676246657514 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 448ms, sequenceid=21, compaction requested=false at 1676246657517 (+3 ms)Writing region close event to WAL at 1676246657518 (+1 ms)Running coprocessor post-close hooks at 1676246657521 (+3 ms)Closed at 1676246657522 (+1 ms) 2023-02-13 00:04:17,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 00:04:17,670 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42551,1676246652778; all regions closed. 2023-02-13 00:04:17,674 DEBUG [RS:1;jenkins-hbase4:42551] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/oldWALs 2023-02-13 00:04:17,675 INFO [RS:1;jenkins-hbase4:42551] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42551%2C1676246652778.meta:.meta(num 1676246653283) 2023-02-13 00:04:17,677 DEBUG [RS:1;jenkins-hbase4:42551] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/oldWALs 2023-02-13 00:04:17,678 INFO [RS:1;jenkins-hbase4:42551] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42551%2C1676246652778:(num 1676246653676) 2023-02-13 00:04:17,678 DEBUG [RS:1;jenkins-hbase4:42551] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,678 INFO [RS:1;jenkins-hbase4:42551] regionserver.LeaseManager(133): Closed leases 2023-02-13 00:04:17,678 INFO [RS:1;jenkins-hbase4:42551] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 00:04:17,678 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:17,680 INFO [RS:1;jenkins-hbase4:42551] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42551 2023-02-13 00:04:17,682 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42551,1676246652778 2023-02-13 00:04:17,682 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 00:04:17,682 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56ae64ea rejected from java.util.concurrent.ThreadPoolExecutor@5291fae7[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,684 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42551,1676246652778] 2023-02-13 00:04:17,684 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42551,1676246652778; numProcessing=2 2023-02-13 00:04:17,685 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42551,1676246652778 already deleted, retry=false 2023-02-13 00:04:17,686 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42551,1676246652778 expired; onlineServers=0 2023-02-13 00:04:17,686 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38801,1676246652697' ***** 2023-02-13 00:04:17,686 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 00:04:17,686 DEBUG [M:0;jenkins-hbase4:38801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b77afc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 00:04:17,687 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38801,1676246652697 2023-02-13 00:04:17,687 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38801,1676246652697; all regions closed. 2023-02-13 00:04:17,687 DEBUG [M:0;jenkins-hbase4:38801] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 00:04:17,687 DEBUG [M:0;jenkins-hbase4:38801] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 00:04:17,687 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 00:04:17,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246652940] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676246652940,5,FailOnTimeoutGroup] 2023-02-13 00:04:17,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246652940] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676246652940,5,FailOnTimeoutGroup] 2023-02-13 00:04:17,687 DEBUG [M:0;jenkins-hbase4:38801] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 00:04:17,688 INFO [M:0;jenkins-hbase4:38801] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 00:04:17,688 INFO [M:0;jenkins-hbase4:38801] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 00:04:17,688 INFO [M:0;jenkins-hbase4:38801] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 00:04:17,688 DEBUG [M:0;jenkins-hbase4:38801] master.HMaster(1502): Stopping service threads 2023-02-13 00:04:17,688 INFO [M:0;jenkins-hbase4:38801] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 00:04:17,689 ERROR [M:0;jenkins-hbase4:38801] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 00:04:17,689 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 00:04:17,689 INFO [M:0;jenkins-hbase4:38801] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 00:04:17,689 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 00:04:17,689 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 00:04:17,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 00:04:17,690 DEBUG [M:0;jenkins-hbase4:38801] zookeeper.ZKUtil(398): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 00:04:17,690 WARN [M:0;jenkins-hbase4:38801] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 00:04:17,690 INFO [M:0;jenkins-hbase4:38801] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 00:04:17,690 INFO [M:0;jenkins-hbase4:38801] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 00:04:17,690 DEBUG [M:0;jenkins-hbase4:38801] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 00:04:17,691 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:17,691 DEBUG [M:0;jenkins-hbase4:38801] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:17,691 DEBUG [M:0;jenkins-hbase4:38801] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 00:04:17,691 DEBUG [M:0;jenkins-hbase4:38801] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:17,691 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.70 KB heapSize=65.67 KB 2023-02-13 00:04:17,698 INFO [M:0;jenkins-hbase4:38801] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.70 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9b039daea2374db787d77926984fdd40 2023-02-13 00:04:17,702 DEBUG [M:0;jenkins-hbase4:38801] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9b039daea2374db787d77926984fdd40 as hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9b039daea2374db787d77926984fdd40 2023-02-13 00:04:17,706 INFO [M:0;jenkins-hbase4:38801] regionserver.HStore(1080): Added hdfs://localhost:38667/user/jenkins/test-data/2986da2c-ac3b-ce73-7a13-85000bb6121e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9b039daea2374db787d77926984fdd40, entries=17, sequenceid=132, filesize=8.6 K 2023-02-13 00:04:17,707 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegion(2947): Finished flush of dataSize ~54.70 KB/56014, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-13 00:04:17,708 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 00:04:17,708 DEBUG [M:0;jenkins-hbase4:38801] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676246657690Disabling compacts and flushes for region at 1676246657690Disabling writes for close at 1676246657691 (+1 ms)Obtaining lock to block concurrent updates at 1676246657691Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676246657691Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56014, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1676246657691Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676246657692 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676246657692Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676246657694 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676246657694Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676246657703 (+9 ms)Finished flush of dataSize ~54.70 KB/56014, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676246657707 (+4 ms)Writing region close event to WAL at 1676246657708 (+1 ms)Closed at 1676246657708 2023-02-13 00:04:17,710 INFO [M:0;jenkins-hbase4:38801] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 00:04:17,710 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 00:04:17,710 INFO [M:0;jenkins-hbase4:38801] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38801 2023-02-13 00:04:17,711 DEBUG [M:0;jenkins-hbase4:38801] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38801,1676246652697 already deleted, retry=false 2023-02-13 00:04:17,785 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:17,785 INFO [RS:1;jenkins-hbase4:42551] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42551,1676246652778; zookeeper connection closed. 2023-02-13 00:04:17,785 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@362b09d rejected from java.util.concurrent.ThreadPoolExecutor@5291fae7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,785 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): regionserver:42551-0x1004afe00cd0002, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:17,785 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@305a8c35] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@305a8c35 2023-02-13 00:04:17,785 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b559dc3 rejected from java.util.concurrent.ThreadPoolExecutor@5291fae7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,785 INFO [Listener at localhost/38351] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 00:04:17,885 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:17,885 INFO [M:0;jenkins-hbase4:38801] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38801,1676246652697; zookeeper connection closed. 2023-02-13 00:04:17,885 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bfe6906 rejected from java.util.concurrent.ThreadPoolExecutor@1fc1eea1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,886 DEBUG [Listener at localhost/38351-EventThread] zookeeper.ZKWatcher(600): master:38801-0x1004afe00cd0000, quorum=127.0.0.1:56761, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 00:04:17,886 ERROR [Listener at localhost/38351-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38d72b9 rejected from java.util.concurrent.ThreadPoolExecutor@1fc1eea1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 00:04:17,886 WARN [Listener at localhost/38351] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:17,890 INFO [Listener at localhost/38351] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:17,991 WARN [BP-1261506599-172.31.14.131-1676246652093 heartbeating to localhost/127.0.0.1:38667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:17,991 WARN [BP-1261506599-172.31.14.131-1676246652093 heartbeating to localhost/127.0.0.1:38667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261506599-172.31.14.131-1676246652093 (Datanode Uuid 7d344d08-512a-40be-bc3c-5a30aba64519) service to localhost/127.0.0.1:38667 2023-02-13 00:04:17,992 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/dfs/data/data3/current/BP-1261506599-172.31.14.131-1676246652093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:17,992 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/dfs/data/data4/current/BP-1261506599-172.31.14.131-1676246652093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:17,994 WARN [Listener at localhost/38351] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 00:04:17,997 INFO [Listener at localhost/38351] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:18,098 WARN [BP-1261506599-172.31.14.131-1676246652093 heartbeating to localhost/127.0.0.1:38667] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 00:04:18,098 WARN [BP-1261506599-172.31.14.131-1676246652093 heartbeating to localhost/127.0.0.1:38667] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261506599-172.31.14.131-1676246652093 (Datanode Uuid 34ba6270-3490-49b4-a6ac-c1c79397c3db) service to localhost/127.0.0.1:38667 2023-02-13 00:04:18,099 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/dfs/data/data1/current/BP-1261506599-172.31.14.131-1676246652093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:18,099 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7865c9d8-8b1d-3746-4f5d-204c642db177/cluster_29a2c998-61ba-3b09-d9e1-e2cc6f03093d/dfs/data/data2/current/BP-1261506599-172.31.14.131-1676246652093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 00:04:18,109 INFO [Listener at localhost/38351] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 00:04:18,222 INFO [Listener at localhost/38351] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 00:04:18,242 INFO [Listener at localhost/38351] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 00:04:18,256 INFO [Listener at localhost/38351] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 273) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38351 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38667 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38801,1676246652697)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:38667 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:38667 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:38667 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:38667 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:38667 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1391831767) connection to localhost/127.0.0.1:38667 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=595 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 265), ProcessCount=168 (was 170), AvailableMemoryMB=3756 (was 3790)