2023-02-15 02:00:53,502 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-15 02:00:53,541 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=163, AvailableMemoryMB=7015 2023-02-15 02:00:53,770 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043 2023-02-15 02:00:53,777 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:00:53,778 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7, deleteOnExit=true 2023-02-15 02:00:53,778 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:00:53,779 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/test.cache.data in system properties and HBase conf 2023-02-15 02:00:53,779 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:00:53,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:00:53,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:00:53,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:00:53,780 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:00:53,877 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-15 02:00:54,251 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:00:54,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:00:54,256 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:00:54,256 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:00:54,256 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:00:54,257 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:00:54,257 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:00:54,257 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:00:54,257 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:00:54,258 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:00:54,258 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:00:54,258 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:00:54,258 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:00:54,259 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:00:54,259 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:00:54,789 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:00:54,796 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:00:55,133 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-15 02:00:55,322 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-15 02:00:55,337 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:00:55,378 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:00:55,413 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/java.io.tmpdir/Jetty_localhost_localdomain_39727_hdfs____1lr14g/webapp 2023-02-15 02:00:55,565 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39727 2023-02-15 02:00:55,576 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:00:55,576 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:00:56,123 WARN [Listener at localhost.localdomain/37131] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:00:56,202 WARN [Listener at localhost.localdomain/37131] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:00:56,224 WARN [Listener at localhost.localdomain/37131] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:00:56,233 INFO [Listener at localhost.localdomain/37131] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:00:56,241 INFO [Listener at localhost.localdomain/37131] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/java.io.tmpdir/Jetty_localhost_40209_datanode____jbzacm/webapp 2023-02-15 02:00:56,353 INFO [Listener at localhost.localdomain/37131] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40209 2023-02-15 02:00:56,760 WARN [Listener at localhost.localdomain/41791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:00:56,775 WARN [Listener at localhost.localdomain/41791] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:00:56,779 WARN [Listener at localhost.localdomain/41791] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:00:56,780 INFO [Listener at localhost.localdomain/41791] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:00:56,792 INFO [Listener at localhost.localdomain/41791] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/java.io.tmpdir/Jetty_localhost_33041_datanode____.1u4tho/webapp 2023-02-15 02:00:56,904 INFO [Listener at localhost.localdomain/41791] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33041 2023-02-15 02:00:56,919 WARN [Listener at localhost.localdomain/44729] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:00:57,205 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2aee616253a5e78c: Processing first storage report for DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9 from datanode 8c9bd998-0665-41dc-be40-4ea03e198511 2023-02-15 02:00:57,207 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2aee616253a5e78c: from storage DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9 node DatanodeRegistration(127.0.0.1:33051, datanodeUuid=8c9bd998-0665-41dc-be40-4ea03e198511, infoPort=33119, infoSecurePort=0, ipcPort=41791, storageInfo=lv=-57;cid=testClusterID;nsid=2062348012;c=1676426454892), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-15 02:00:57,207 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x45ddb434e6609169: Processing first storage report for DS-e823801b-9b26-4458-a40b-e3a50cc310b5 from datanode d52bd59f-570e-4c75-a412-9fe8c0b8504f 2023-02-15 02:00:57,207 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x45ddb434e6609169: from storage DS-e823801b-9b26-4458-a40b-e3a50cc310b5 node DatanodeRegistration(127.0.0.1:43459, datanodeUuid=d52bd59f-570e-4c75-a412-9fe8c0b8504f, infoPort=33941, infoSecurePort=0, ipcPort=44729, storageInfo=lv=-57;cid=testClusterID;nsid=2062348012;c=1676426454892), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 02:00:57,208 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2aee616253a5e78c: Processing first storage report for DS-f3efc87a-36d6-497e-801b-00e50c1c116e from datanode 8c9bd998-0665-41dc-be40-4ea03e198511 2023-02-15 02:00:57,208 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2aee616253a5e78c: from storage DS-f3efc87a-36d6-497e-801b-00e50c1c116e node DatanodeRegistration(127.0.0.1:33051, datanodeUuid=8c9bd998-0665-41dc-be40-4ea03e198511, infoPort=33119, infoSecurePort=0, ipcPort=41791, storageInfo=lv=-57;cid=testClusterID;nsid=2062348012;c=1676426454892), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:00:57,208 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x45ddb434e6609169: Processing first storage report for DS-1ca0e22b-4c42-4d8b-8ddf-8317ae3a2a96 from datanode d52bd59f-570e-4c75-a412-9fe8c0b8504f 2023-02-15 02:00:57,208 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x45ddb434e6609169: from storage DS-1ca0e22b-4c42-4d8b-8ddf-8317ae3a2a96 node DatanodeRegistration(127.0.0.1:43459, datanodeUuid=d52bd59f-570e-4c75-a412-9fe8c0b8504f, infoPort=33941, infoSecurePort=0, ipcPort=44729, storageInfo=lv=-57;cid=testClusterID;nsid=2062348012;c=1676426454892), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:00:57,367 DEBUG [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043 2023-02-15 02:00:57,450 INFO [Listener at localhost.localdomain/44729] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/zookeeper_0, clientPort=50976, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:00:57,472 INFO [Listener at localhost.localdomain/44729] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50976 2023-02-15 02:00:57,483 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:57,486 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:58,144 INFO [Listener at localhost.localdomain/44729] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647 with version=8 2023-02-15 02:00:58,144 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:58,146 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:58,149 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/hbase-staging 2023-02-15 02:00:58,435 INFO [Listener at localhost.localdomain/44729] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-15 02:00:58,822 INFO [Listener at localhost.localdomain/44729] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:00:58,848 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:58,849 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:58,849 INFO [Listener at localhost.localdomain/44729] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:00:58,849 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:58,849 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:00:58,971 INFO [Listener at localhost.localdomain/44729] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:00:59,036 DEBUG [Listener at localhost.localdomain/44729] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-15 02:00:59,136 INFO [Listener at localhost.localdomain/44729] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45815 2023-02-15 02:00:59,146 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,148 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,170 INFO [Listener at localhost.localdomain/44729] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45815 connecting to ZooKeeper ensemble=127.0.0.1:50976 2023-02-15 02:00:59,227 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:458150x0, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:00:59,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45815-0x10163dd73050000 connected 2023-02-15 02:00:59,254 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:00:59,255 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:00:59,258 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:00:59,270 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45815 2023-02-15 02:00:59,270 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45815 2023-02-15 02:00:59,270 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45815 2023-02-15 02:00:59,271 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45815 2023-02-15 02:00:59,273 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45815 2023-02-15 02:00:59,279 INFO [Listener at localhost.localdomain/44729] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647, hbase.cluster.distributed=false 2023-02-15 02:00:59,341 INFO [Listener at localhost.localdomain/44729] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:00:59,342 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:59,342 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:59,342 INFO [Listener at localhost.localdomain/44729] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:00:59,342 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:59,342 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:00:59,346 INFO [Listener at localhost.localdomain/44729] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:00:59,349 INFO [Listener at localhost.localdomain/44729] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33675 2023-02-15 02:00:59,351 INFO [Listener at localhost.localdomain/44729] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:00:59,358 DEBUG [Listener at localhost.localdomain/44729] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:00:59,359 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,361 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,362 INFO [Listener at localhost.localdomain/44729] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33675 connecting to ZooKeeper ensemble=127.0.0.1:50976 2023-02-15 02:00:59,365 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:336750x0, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:00:59,366 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): regionserver:336750x0, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:00:59,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33675-0x10163dd73050001 connected 2023-02-15 02:00:59,367 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:00:59,368 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:00:59,375 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33675 2023-02-15 02:00:59,375 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33675 2023-02-15 02:00:59,375 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33675 2023-02-15 02:00:59,376 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33675 2023-02-15 02:00:59,376 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33675 2023-02-15 02:00:59,386 INFO [Listener at localhost.localdomain/44729] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:00:59,386 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:59,386 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:59,387 INFO [Listener at localhost.localdomain/44729] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:00:59,387 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:00:59,387 INFO [Listener at localhost.localdomain/44729] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:00:59,387 INFO [Listener at localhost.localdomain/44729] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:00:59,388 INFO [Listener at localhost.localdomain/44729] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44999 2023-02-15 02:00:59,389 INFO [Listener at localhost.localdomain/44729] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:00:59,391 DEBUG [Listener at localhost.localdomain/44729] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:00:59,392 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,394 INFO [Listener at localhost.localdomain/44729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,396 INFO [Listener at localhost.localdomain/44729] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44999 connecting to ZooKeeper ensemble=127.0.0.1:50976 2023-02-15 02:00:59,401 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:449990x0, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:00:59,402 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): regionserver:449990x0, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:00:59,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44999-0x10163dd73050002 connected 2023-02-15 02:00:59,403 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:00:59,404 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:00:59,406 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44999 2023-02-15 02:00:59,406 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44999 2023-02-15 02:00:59,406 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44999 2023-02-15 02:00:59,411 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44999 2023-02-15 02:00:59,411 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44999 2023-02-15 02:00:59,412 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:00:59,420 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:00:59,422 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:00:59,438 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:00:59,438 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:00:59,439 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:00:59,438 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:00:59,440 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:00:59,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:00:59,441 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,45815,1676426458286 from backup master directory 2023-02-15 02:00:59,445 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:00:59,445 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:00:59,446 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:00:59,446 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:00:59,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-15 02:00:59,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-15 02:00:59,547 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/hbase.id with ID: 28b3eea3-3836-478e-b9cb-6a5272abc134 2023-02-15 02:00:59,587 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:00:59,603 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:00:59,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x00b4ce18 to 127.0.0.1:50976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:00:59,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73937cbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:00:59,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:00:59,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:00:59,713 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-15 02:00:59,713 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-15 02:00:59,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 02:00:59,718 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 02:00:59,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:00:59,749 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store-tmp 2023-02-15 02:00:59,778 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:00:59,778 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:00:59,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:00:59,779 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:00:59,779 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:00:59,779 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:00:59,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:00:59,779 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:00:59,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/WALs/jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:00:59,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45815%2C1676426458286, suffix=, logDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/WALs/jenkins-hbase20.apache.org,45815,1676426458286, archiveDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/oldWALs, maxLogs=10 2023-02-15 02:00:59,865 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK] 2023-02-15 02:00:59,865 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK] 2023-02-15 02:00:59,876 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-15 02:00:59,939 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/WALs/jenkins-hbase20.apache.org,45815,1676426458286/jenkins-hbase20.apache.org%2C45815%2C1676426458286.1676426459811 2023-02-15 02:00:59,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK], DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK]] 2023-02-15 02:00:59,940 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:00:59,940 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:00:59,945 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:00:59,946 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:00,019 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:00,027 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:00,060 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:00,071 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:00,078 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:00,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:00,097 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:00,102 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:00,103 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59728058, jitterRate=-0.10998257994651794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:00,103 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:00,104 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:00,124 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:00,124 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:00,126 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:00,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-15 02:01:00,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 29 msec 2023-02-15 02:01:00,158 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:00,184 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:00,190 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:00,212 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:00,216 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:00,217 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:00,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:00,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:00,228 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:00,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:00,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:00,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:00,251 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:00,251 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:00,251 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:00,251 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:00,252 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,45815,1676426458286, sessionid=0x10163dd73050000, setting cluster-up flag (Was=false) 2023-02-15 02:01:00,266 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:00,270 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:00,271 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:01:00,286 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:00,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:00,292 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:01:00,295 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.hbase-snapshot/.tmp 2023-02-15 02:01:00,315 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(952): ClusterId : 28b3eea3-3836-478e-b9cb-6a5272abc134 2023-02-15 02:01:00,315 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(952): ClusterId : 28b3eea3-3836-478e-b9cb-6a5272abc134 2023-02-15 02:01:00,322 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:00,322 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:00,328 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:00,328 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:00,328 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:00,328 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:00,332 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:00,332 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:00,333 DEBUG [RS:0;jenkins-hbase20:33675] zookeeper.ReadOnlyZKClient(139): Connect 0x73c06bff to 127.0.0.1:50976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:00,334 DEBUG [RS:1;jenkins-hbase20:44999] zookeeper.ReadOnlyZKClient(139): Connect 0x574f2949 to 127.0.0.1:50976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:00,346 DEBUG [RS:0;jenkins-hbase20:33675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d079bf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:00,346 DEBUG [RS:1;jenkins-hbase20:44999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5988ddd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:00,346 DEBUG [RS:0;jenkins-hbase20:33675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7938008f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:00,347 DEBUG [RS:1;jenkins-hbase20:44999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db74239, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:00,366 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:33675 2023-02-15 02:01:00,371 INFO [RS:0;jenkins-hbase20:33675] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:00,371 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:44999 2023-02-15 02:01:00,371 INFO [RS:0;jenkins-hbase20:33675] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:00,372 INFO [RS:1;jenkins-hbase20:44999] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:00,372 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:00,372 INFO [RS:1;jenkins-hbase20:44999] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:00,372 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:00,375 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45815,1676426458286 with isa=jenkins-hbase20.apache.org/148.251.75.209:44999, startcode=1676426459385 2023-02-15 02:01:00,375 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45815,1676426458286 with isa=jenkins-hbase20.apache.org/148.251.75.209:33675, startcode=1676426459341 2023-02-15 02:01:00,398 DEBUG [RS:1;jenkins-hbase20:44999] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:00,398 DEBUG [RS:0;jenkins-hbase20:33675] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:00,438 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:00,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:00,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:00,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:00,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:00,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:00,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:00,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:00,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:00,450 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426490450 2023-02-15 02:01:00,453 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:00,454 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43081, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:00,454 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55239, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:00,458 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:00,459 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:00,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:00,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:00,465 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:00,465 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:00,472 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:00,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:00,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:00,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:00,479 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:00,481 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:00,482 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:00,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:00,485 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:00,486 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:00,488 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426460488,5,FailOnTimeoutGroup] 2023-02-15 02:01:00,488 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426460488,5,FailOnTimeoutGroup] 2023-02-15 02:01:00,488 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:00,489 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:00,490 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:00,490 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:00,504 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(2829): Master is not running yet 2023-02-15 02:01:00,504 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(2829): Master is not running yet 2023-02-15 02:01:00,508 WARN [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-15 02:01:00,508 WARN [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-15 02:01:00,511 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:00,512 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:00,513 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647 2023-02-15 02:01:00,528 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:00,531 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:00,534 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/info 2023-02-15 02:01:00,535 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:00,536 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:00,536 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:00,539 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:00,540 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:00,541 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:00,541 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:00,544 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/table 2023-02-15 02:01:00,544 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:00,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:00,547 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740 2023-02-15 02:01:00,548 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740 2023-02-15 02:01:00,552 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:00,554 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:00,558 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:00,560 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63785395, jitterRate=-0.049523547291755676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:00,560 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:00,560 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:00,560 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:00,560 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:00,560 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:00,560 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:00,561 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:00,561 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:00,566 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:00,566 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:00,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:00,584 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:00,587 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:00,737 WARN [jenkins-hbase20:45815] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-15 02:01:01,509 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45815,1676426458286 with isa=jenkins-hbase20.apache.org/148.251.75.209:33675, startcode=1676426459341 2023-02-15 02:01:01,509 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45815,1676426458286 with isa=jenkins-hbase20.apache.org/148.251.75.209:44999, startcode=1676426459385 2023-02-15 02:01:01,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45815] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,520 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647 2023-02-15 02:01:01,520 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647 2023-02-15 02:01:01,520 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37131 2023-02-15 02:01:01,520 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:01,520 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37131 2023-02-15 02:01:01,521 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:01,529 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:01,529 DEBUG [RS:1;jenkins-hbase20:44999] zookeeper.ZKUtil(162): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,529 DEBUG [RS:0;jenkins-hbase20:33675] zookeeper.ZKUtil(162): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,529 WARN [RS:1;jenkins-hbase20:44999] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:01,529 WARN [RS:0;jenkins-hbase20:33675] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:01,530 INFO [RS:1;jenkins-hbase20:44999] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:01,530 INFO [RS:0;jenkins-hbase20:33675] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:01,531 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,531 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,531 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33675,1676426459341] 2023-02-15 02:01:01,531 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44999,1676426459385] 2023-02-15 02:01:01,548 DEBUG [RS:0;jenkins-hbase20:33675] zookeeper.ZKUtil(162): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,549 DEBUG [RS:0;jenkins-hbase20:33675] zookeeper.ZKUtil(162): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,550 DEBUG [RS:1;jenkins-hbase20:44999] zookeeper.ZKUtil(162): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,550 DEBUG [RS:1;jenkins-hbase20:44999] zookeeper.ZKUtil(162): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,564 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:01,564 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:01,577 INFO [RS:0;jenkins-hbase20:33675] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:01,577 INFO [RS:1;jenkins-hbase20:44999] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:01,626 INFO [RS:1;jenkins-hbase20:44999] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:01,626 INFO [RS:0;jenkins-hbase20:33675] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:01,631 INFO [RS:1;jenkins-hbase20:44999] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:01,631 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,632 INFO [RS:0;jenkins-hbase20:33675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:01,635 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:01,635 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,639 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:01,648 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,648 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,648 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,648 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,649 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:01,649 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:01,650 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:1;jenkins-hbase20:44999] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,650 DEBUG [RS:0;jenkins-hbase20:33675] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:01,659 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,659 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,659 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,659 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,660 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,660 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,676 INFO [RS:0;jenkins-hbase20:33675] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:01,676 INFO [RS:1;jenkins-hbase20:44999] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:01,680 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44999,1676426459385-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,680 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33675,1676426459341-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:01,704 INFO [RS:0;jenkins-hbase20:33675] regionserver.Replication(203): jenkins-hbase20.apache.org,33675,1676426459341 started 2023-02-15 02:01:01,705 INFO [RS:1;jenkins-hbase20:44999] regionserver.Replication(203): jenkins-hbase20.apache.org,44999,1676426459385 started 2023-02-15 02:01:01,705 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33675,1676426459341, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33675, sessionid=0x10163dd73050001 2023-02-15 02:01:01,705 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,44999,1676426459385, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44999, sessionid=0x10163dd73050002 2023-02-15 02:01:01,705 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:01,705 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:01,705 DEBUG [RS:0;jenkins-hbase20:33675] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,705 DEBUG [RS:1;jenkins-hbase20:44999] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,706 DEBUG [RS:0;jenkins-hbase20:33675] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33675,1676426459341' 2023-02-15 02:01:01,706 DEBUG [RS:1;jenkins-hbase20:44999] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44999,1676426459385' 2023-02-15 02:01:01,706 DEBUG [RS:0;jenkins-hbase20:33675] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:01,706 DEBUG [RS:1;jenkins-hbase20:44999] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:01,707 DEBUG [RS:0;jenkins-hbase20:33675] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:01,707 DEBUG [RS:1;jenkins-hbase20:44999] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:01,708 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:01,708 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:01,708 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:01,708 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:01,708 DEBUG [RS:1;jenkins-hbase20:44999] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,708 DEBUG [RS:0;jenkins-hbase20:33675] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:01,709 DEBUG [RS:1;jenkins-hbase20:44999] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44999,1676426459385' 2023-02-15 02:01:01,709 DEBUG [RS:0;jenkins-hbase20:33675] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33675,1676426459341' 2023-02-15 02:01:01,709 DEBUG [RS:1;jenkins-hbase20:44999] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:01,709 DEBUG [RS:0;jenkins-hbase20:33675] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:01,711 DEBUG [RS:0;jenkins-hbase20:33675] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:01,711 DEBUG [RS:1;jenkins-hbase20:44999] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:01,712 DEBUG [RS:1;jenkins-hbase20:44999] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:01,712 DEBUG [RS:0;jenkins-hbase20:33675] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:01,712 INFO [RS:1;jenkins-hbase20:44999] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:01,713 INFO [RS:1;jenkins-hbase20:44999] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:01,712 INFO [RS:0;jenkins-hbase20:33675] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:01,713 INFO [RS:0;jenkins-hbase20:33675] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:01,740 DEBUG [jenkins-hbase20:45815] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:01,744 DEBUG [jenkins-hbase20:45815] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:01,752 DEBUG [jenkins-hbase20:45815] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:01,752 DEBUG [jenkins-hbase20:45815] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:01,752 DEBUG [jenkins-hbase20:45815] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:01,755 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44999,1676426459385, state=OPENING 2023-02-15 02:01:01,762 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:01,763 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:01,764 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:01,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:01,955 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:01,957 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:01,959 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41824, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:01,971 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:01,972 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:01,975 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44999%2C1676426459385.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,44999,1676426459385, archiveDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/oldWALs, maxLogs=32 2023-02-15 02:01:01,995 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK] 2023-02-15 02:01:01,995 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK] 2023-02-15 02:01:02,003 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,44999,1676426459385/jenkins-hbase20.apache.org%2C44999%2C1676426459385.meta.1676426461979.meta 2023-02-15 02:01:02,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK], DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK]] 2023-02-15 02:01:02,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:02,006 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:02,026 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:02,031 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:02,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:02,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:02,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:02,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:02,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:02,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/info 2023-02-15 02:01:02,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/info 2023-02-15 02:01:02,041 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:02,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:02,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:02,044 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:02,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:02,047 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:02,048 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:02,048 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:02,050 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/table 2023-02-15 02:01:02,050 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/table 2023-02-15 02:01:02,051 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:02,052 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:02,055 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740 2023-02-15 02:01:02,070 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740 2023-02-15 02:01:02,074 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:02,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:02,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73251561, jitterRate=0.09153331816196442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:02,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:02,090 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426461949 2023-02-15 02:01:02,111 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:02,112 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:02,112 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44999,1676426459385, state=OPEN 2023-02-15 02:01:02,114 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:02,115 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:02,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:02,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44999,1676426459385 in 347 msec 2023-02-15 02:01:02,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:02,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5470 sec 2023-02-15 02:01:02,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7670 sec 2023-02-15 02:01:02,130 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426462129, completionTime=-1 2023-02-15 02:01:02,130 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:02,130 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:02,193 DEBUG [hconnection-0x3edce7d6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:02,195 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41836, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:02,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:02,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426522236 2023-02-15 02:01:02,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426582236 2023-02-15 02:01:02,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 106 msec 2023-02-15 02:01:02,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45815,1676426458286-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:02,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45815,1676426458286-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:02,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45815,1676426458286-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:02,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:45815, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:02,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:02,274 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:02,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:02,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:02,293 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:02,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:02,298 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:02,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/hbase/namespace/fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,325 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/hbase/namespace/fc8be43497612e90df605dc7710143c4 empty. 2023-02-15 02:01:02,326 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/hbase/namespace/fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,326 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:02,352 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:02,354 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc8be43497612e90df605dc7710143c4, NAME => 'hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:02,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:02,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fc8be43497612e90df605dc7710143c4, disabling compactions & flushes 2023-02-15 02:01:02,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. after waiting 0 ms 2023-02-15 02:01:02,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,375 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fc8be43497612e90df605dc7710143c4: 2023-02-15 02:01:02,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:02,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426462382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426462382"}]},"ts":"1676426462382"} 2023-02-15 02:01:02,422 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:02,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:02,428 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426462424"}]},"ts":"1676426462424"} 2023-02-15 02:01:02,433 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:02,436 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:02,438 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:02,438 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:02,438 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:02,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fc8be43497612e90df605dc7710143c4, ASSIGN}] 2023-02-15 02:01:02,444 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fc8be43497612e90df605dc7710143c4, ASSIGN 2023-02-15 02:01:02,447 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fc8be43497612e90df605dc7710143c4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33675,1676426459341; forceNewPlan=false, retain=false 2023-02-15 02:01:02,599 INFO [jenkins-hbase20:45815] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:02,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fc8be43497612e90df605dc7710143c4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:02,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426462600"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426462600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426462600"}]},"ts":"1676426462600"} 2023-02-15 02:01:02,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fc8be43497612e90df605dc7710143c4, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:02,723 INFO [RS:0;jenkins-hbase20:33675] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33675%2C1676426459341, suffix=, logDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,33675,1676426459341, archiveDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/oldWALs, maxLogs=32 2023-02-15 02:01:02,724 INFO [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44999%2C1676426459385, suffix=, logDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,44999,1676426459385, archiveDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/oldWALs, maxLogs=32 2023-02-15 02:01:02,743 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK] 2023-02-15 02:01:02,747 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK] 2023-02-15 02:01:02,748 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK] 2023-02-15 02:01:02,748 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK] 2023-02-15 02:01:02,753 INFO [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,44999,1676426459385/jenkins-hbase20.apache.org%2C44999%2C1676426459385.1676426462726 2023-02-15 02:01:02,754 DEBUG [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK], DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK]] 2023-02-15 02:01:02,755 INFO [RS:0;jenkins-hbase20:33675] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/WALs/jenkins-hbase20.apache.org,33675,1676426459341/jenkins-hbase20.apache.org%2C33675%2C1676426459341.1676426462724 2023-02-15 02:01:02,756 DEBUG [RS:0;jenkins-hbase20:33675] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43459,DS-e823801b-9b26-4458-a40b-e3a50cc310b5,DISK], DatanodeInfoWithStorage[127.0.0.1:33051,DS-b9ddde82-e632-4cb6-a439-1a3053cc54e9,DISK]] 2023-02-15 02:01:02,764 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:02,765 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:02,788 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:02,796 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc8be43497612e90df605dc7710143c4, NAME => 'hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:02,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:02,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,806 INFO [StoreOpener-fc8be43497612e90df605dc7710143c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,809 DEBUG [StoreOpener-fc8be43497612e90df605dc7710143c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/info 2023-02-15 02:01:02,809 DEBUG [StoreOpener-fc8be43497612e90df605dc7710143c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/info 2023-02-15 02:01:02,810 INFO [StoreOpener-fc8be43497612e90df605dc7710143c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc8be43497612e90df605dc7710143c4 columnFamilyName info 2023-02-15 02:01:02,810 INFO [StoreOpener-fc8be43497612e90df605dc7710143c4-1] regionserver.HStore(310): Store=fc8be43497612e90df605dc7710143c4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:02,812 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:02,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:02,835 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened fc8be43497612e90df605dc7710143c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64799433, jitterRate=-0.03441320359706879}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:02,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for fc8be43497612e90df605dc7710143c4: 2023-02-15 02:01:02,837 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4., pid=6, masterSystemTime=1676426462761 2023-02-15 02:01:02,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,843 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:02,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fc8be43497612e90df605dc7710143c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:02,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426462843"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426462843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426462843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426462843"}]},"ts":"1676426462843"} 2023-02-15 02:01:02,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:02,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fc8be43497612e90df605dc7710143c4, server=jenkins-hbase20.apache.org,33675,1676426459341 in 241 msec 2023-02-15 02:01:02,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:02,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fc8be43497612e90df605dc7710143c4, ASSIGN in 411 msec 2023-02-15 02:01:02,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:02,858 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426462858"}]},"ts":"1676426462858"} 2023-02-15 02:01:02,862 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:02,866 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:02,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 582 msec 2023-02-15 02:01:02,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:02,897 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:02,897 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:02,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:02,927 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:02,955 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:02,978 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:02,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-02-15 02:01:02,990 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:03,003 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:03,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-15 02:01:03,017 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:03,019 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:03,019 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.573sec 2023-02-15 02:01:03,021 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:03,023 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:03,023 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:03,024 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45815,1676426458286-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:03,026 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45815,1676426458286-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:03,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:03,039 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ReadOnlyZKClient(139): Connect 0x6a6375fb to 127.0.0.1:50976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:03,044 DEBUG [Listener at localhost.localdomain/44729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7374f766, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:03,100 DEBUG [hconnection-0x4a730f0f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:03,111 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:03,121 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:01:03,121 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:03,129 DEBUG [Listener at localhost.localdomain/44729] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:03,132 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:03,137 INFO [Listener at localhost.localdomain/44729] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 02:01:03,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-15 02:01:03,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:03,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 148.251.75.209:41238 deadline: 1676426523141, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 02:01:03,145 INFO [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 02:01:03,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:03,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 02:01:03,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:03,169 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:03,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 02:01:03,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:03,194 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:03,194 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:03,194 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:03,194 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:03,194 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:03,194 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:03,195 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 empty. 2023-02-15 02:01:03,195 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:03,195 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:03,195 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a empty. 2023-02-15 02:01:03,195 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d empty. 2023-02-15 02:01:03,196 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 empty. 2023-02-15 02:01:03,196 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f empty. 2023-02-15 02:01:03,196 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 empty. 2023-02-15 02:01:03,198 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 empty. 2023-02-15 02:01:03,198 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a empty. 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:03,198 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:03,199 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:03,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 empty. 2023-02-15 02:01:03,200 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 empty. 2023-02-15 02:01:03,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:03,200 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:03,200 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 02:01:03,222 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:03,224 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c46656db903b7cf9404e8d31878c69f4, NAME => 'testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,224 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6b9fd63d89233bbf287c4ca3eb70a65a, NAME => 'testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,224 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8683f26dde3a7c4fce3afc36e3dd7b00, NAME => 'testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,263 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,263 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,263 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8683f26dde3a7c4fce3afc36e3dd7b00, disabling compactions & flushes 2023-02-15 02:01:03,263 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:03,264 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:03,263 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6b9fd63d89233bbf287c4ca3eb70a65a, disabling compactions & flushes 2023-02-15 02:01:03,264 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:03,264 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:03,264 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. after waiting 0 ms 2023-02-15 02:01:03,264 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:03,264 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. after waiting 0 ms 2023-02-15 02:01:03,265 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:03,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:03,265 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:03,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:03,265 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:03,267 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => dadf1f57dfe4b02ed1edf951d27e37e4, NAME => 'testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,267 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8d82f194d69d4ff1d5554e16b717456f, NAME => 'testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c46656db903b7cf9404e8d31878c69f4, disabling compactions & flushes 2023-02-15 02:01:03,272 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:03,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:03,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. after waiting 0 ms 2023-02-15 02:01:03,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:03,272 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:03,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:03,273 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 289e79097eeee10570ba41c9e93aede4, NAME => 'testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:03,300 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,300 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing dadf1f57dfe4b02ed1edf951d27e37e4, disabling compactions & flushes 2023-02-15 02:01:03,300 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:03,301 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:03,301 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. after waiting 0 ms 2023-02-15 02:01:03,301 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:03,301 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:03,301 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:03,301 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d43d8807bc1c0144bcbf7ce1fa4ef60a, NAME => 'testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8d82f194d69d4ff1d5554e16b717456f, disabling compactions & flushes 2023-02-15 02:01:03,309 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:03,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:03,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. after waiting 0 ms 2023-02-15 02:01:03,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:03,309 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:03,309 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:03,310 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ba2c16292696f40ac0d6ee553409024d, NAME => 'testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,325 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d43d8807bc1c0144bcbf7ce1fa4ef60a, disabling compactions & flushes 2023-02-15 02:01:03,326 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:03,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:03,327 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. after waiting 0 ms 2023-02-15 02:01:03,327 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:03,327 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:03,327 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:03,327 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8bf5e331546fa7419c02dfbb7aeaf1e3, NAME => 'testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,335 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,336 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ba2c16292696f40ac0d6ee553409024d, disabling compactions & flushes 2023-02-15 02:01:03,336 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:03,336 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:03,336 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. after waiting 0 ms 2023-02-15 02:01:03,336 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:03,336 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:03,336 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:03,337 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 80e0322f2d623adea82dcbb185d7cb08, NAME => 'testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp 2023-02-15 02:01:03,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8bf5e331546fa7419c02dfbb7aeaf1e3, disabling compactions & flushes 2023-02-15 02:01:03,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:03,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:03,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. after waiting 0 ms 2023-02-15 02:01:03,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:03,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:03,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:03,364 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,365 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 80e0322f2d623adea82dcbb185d7cb08, disabling compactions & flushes 2023-02-15 02:01:03,365 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:03,365 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:03,365 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. after waiting 0 ms 2023-02-15 02:01:03,365 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:03,365 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:03,365 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:03,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:03,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:03,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 289e79097eeee10570ba41c9e93aede4, disabling compactions & flushes 2023-02-15 02:01:03,711 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:03,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:03,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. after waiting 0 ms 2023-02-15 02:01:03,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:03,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:03,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:03,723 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:03,724 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,724 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426463724"}]},"ts":"1676426463724"} 2023-02-15 02:01:03,769 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 02:01:03,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:03,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426463771"}]},"ts":"1676426463771"} 2023-02-15 02:01:03,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 02:01:03,779 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:03,795 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:03,795 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:03,795 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:03,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, ASSIGN}] 2023-02-15 02:01:03,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:03,801 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, ASSIGN 2023-02-15 02:01:03,802 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, ASSIGN 2023-02-15 02:01:03,802 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, ASSIGN 2023-02-15 02:01:03,803 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, ASSIGN 2023-02-15 02:01:03,804 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33675,1676426459341; forceNewPlan=false, retain=false 2023-02-15 02:01:03,804 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44999,1676426459385; forceNewPlan=false, retain=false 2023-02-15 02:01:03,805 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, ASSIGN 2023-02-15 02:01:03,811 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33675,1676426459341; forceNewPlan=false, retain=false 2023-02-15 02:01:03,811 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33675,1676426459341; forceNewPlan=false, retain=false 2023-02-15 02:01:03,815 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, ASSIGN 2023-02-15 02:01:03,816 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, ASSIGN 2023-02-15 02:01:03,816 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, ASSIGN 2023-02-15 02:01:03,816 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, ASSIGN 2023-02-15 02:01:03,817 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44999,1676426459385; forceNewPlan=false, retain=false 2023-02-15 02:01:03,819 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33675,1676426459341; forceNewPlan=false, retain=false 2023-02-15 02:01:03,819 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44999,1676426459385; forceNewPlan=false, retain=false 2023-02-15 02:01:03,820 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33675,1676426459341; forceNewPlan=false, retain=false 2023-02-15 02:01:03,820 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44999,1676426459385; forceNewPlan=false, retain=false 2023-02-15 02:01:03,822 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, ASSIGN 2023-02-15 02:01:03,824 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44999,1676426459385; forceNewPlan=false, retain=false 2023-02-15 02:01:03,955 INFO [jenkins-hbase20:45815] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 02:01:03,957 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=289e79097eeee10570ba41c9e93aede4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:03,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d43d8807bc1c0144bcbf7ce1fa4ef60a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:03,957 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8bf5e331546fa7419c02dfbb7aeaf1e3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:03,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dadf1f57dfe4b02ed1edf951d27e37e4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:03,957 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=6b9fd63d89233bbf287c4ca3eb70a65a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:03,958 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463957"}]},"ts":"1676426463957"} 2023-02-15 02:01:03,958 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463957"}]},"ts":"1676426463957"} 2023-02-15 02:01:03,958 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463957"}]},"ts":"1676426463957"} 2023-02-15 02:01:03,958 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463957"}]},"ts":"1676426463957"} 2023-02-15 02:01:03,958 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463957"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463957"}]},"ts":"1676426463957"} 2023-02-15 02:01:03,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 289e79097eeee10570ba41c9e93aede4, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:03,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure d43d8807bc1c0144bcbf7ce1fa4ef60a, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:03,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure dadf1f57dfe4b02ed1edf951d27e37e4, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:03,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 8bf5e331546fa7419c02dfbb7aeaf1e3, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:03,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure 6b9fd63d89233bbf287c4ca3eb70a65a, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:03,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c46656db903b7cf9404e8d31878c69f4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:03,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426463970"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463970"}]},"ts":"1676426463970"} 2023-02-15 02:01:03,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8d82f194d69d4ff1d5554e16b717456f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:03,972 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463971"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463971"}]},"ts":"1676426463971"} 2023-02-15 02:01:03,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure c46656db903b7cf9404e8d31878c69f4, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:03,974 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8683f26dde3a7c4fce3afc36e3dd7b00, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:03,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463974"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463974"}]},"ts":"1676426463974"} 2023-02-15 02:01:03,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 8d82f194d69d4ff1d5554e16b717456f, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:03,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 8683f26dde3a7c4fce3afc36e3dd7b00, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:03,979 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=80e0322f2d623adea82dcbb185d7cb08, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:03,979 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ba2c16292696f40ac0d6ee553409024d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:03,979 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426463978"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463978"}]},"ts":"1676426463978"} 2023-02-15 02:01:03,980 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426463979"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426463979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426463979"}]},"ts":"1676426463979"} 2023-02-15 02:01:03,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure 80e0322f2d623adea82dcbb185d7cb08, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:03,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure ba2c16292696f40ac0d6ee553409024d, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:04,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b9fd63d89233bbf287c4ca3eb70a65a, NAME => 'testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 02:01:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,123 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,125 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1 2023-02-15 02:01:04,126 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1 2023-02-15 02:01:04,126 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b9fd63d89233bbf287c4ca3eb70a65a columnFamilyName f1 2023-02-15 02:01:04,128 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(310): Store=6b9fd63d89233bbf287c4ca3eb70a65a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,128 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,131 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2 2023-02-15 02:01:04,131 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2 2023-02-15 02:01:04,132 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b9fd63d89233bbf287c4ca3eb70a65a columnFamilyName f2 2023-02-15 02:01:04,133 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(310): Store=6b9fd63d89233bbf287c4ca3eb70a65a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:04,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 80e0322f2d623adea82dcbb185d7cb08, NAME => 'testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 02:01:04,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,141 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:04,143 DEBUG [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f1 2023-02-15 02:01:04,143 DEBUG [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f1 2023-02-15 02:01:04,144 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80e0322f2d623adea82dcbb185d7cb08 columnFamilyName f1 2023-02-15 02:01:04,144 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(310): Store=80e0322f2d623adea82dcbb185d7cb08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,145 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,147 DEBUG [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f2 2023-02-15 02:01:04,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 6b9fd63d89233bbf287c4ca3eb70a65a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63063664, jitterRate=-0.06027817726135254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,147 DEBUG [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f2 2023-02-15 02:01:04,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:04,148 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80e0322f2d623adea82dcbb185d7cb08 columnFamilyName f2 2023-02-15 02:01:04,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a., pid=25, masterSystemTime=1676426464114 2023-02-15 02:01:04,149 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(310): Store=80e0322f2d623adea82dcbb185d7cb08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:04,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:04,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:04,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8bf5e331546fa7419c02dfbb7aeaf1e3, NAME => 'testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 02:01:04,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,153 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=6b9fd63d89233bbf287c4ca3eb70a65a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:04,154 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464153"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464153"}]},"ts":"1676426464153"} 2023-02-15 02:01:04,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,157 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,160 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1 2023-02-15 02:01:04,160 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1 2023-02-15 02:01:04,161 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bf5e331546fa7419c02dfbb7aeaf1e3 columnFamilyName f1 2023-02-15 02:01:04,162 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(310): Store=8bf5e331546fa7419c02dfbb7aeaf1e3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,162 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:04,165 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2 2023-02-15 02:01:04,165 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2 2023-02-15 02:01:04,166 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bf5e331546fa7419c02dfbb7aeaf1e3 columnFamilyName f2 2023-02-15 02:01:04,167 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(310): Store=8bf5e331546fa7419c02dfbb7aeaf1e3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-15 02:01:04,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure 6b9fd63d89233bbf287c4ca3eb70a65a, server=jenkins-hbase20.apache.org,44999,1676426459385 in 192 msec 2023-02-15 02:01:04,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 80e0322f2d623adea82dcbb185d7cb08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75234706, jitterRate=0.12108448147773743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:04,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08., pid=29, masterSystemTime=1676426464130 2023-02-15 02:01:04,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, ASSIGN in 376 msec 2023-02-15 02:01:04,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:04,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:04,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:04,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ba2c16292696f40ac0d6ee553409024d, NAME => 'testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 02:01:04,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:04,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=80e0322f2d623adea82dcbb185d7cb08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:04,183 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426464182"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464182"}]},"ts":"1676426464182"} 2023-02-15 02:01:04,187 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-15 02:01:04,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, ASSIGN in 394 msec 2023-02-15 02:01:04,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure 80e0322f2d623adea82dcbb185d7cb08, server=jenkins-hbase20.apache.org,33675,1676426459341 in 199 msec 2023-02-15 02:01:04,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,197 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1 2023-02-15 02:01:04,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8bf5e331546fa7419c02dfbb7aeaf1e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69101634, jitterRate=0.029694586992263794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,197 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1 2023-02-15 02:01:04,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:04,198 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba2c16292696f40ac0d6ee553409024d columnFamilyName f1 2023-02-15 02:01:04,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3., pid=24, masterSystemTime=1676426464114 2023-02-15 02:01:04,200 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(310): Store=ba2c16292696f40ac0d6ee553409024d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,201 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,203 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2 2023-02-15 02:01:04,204 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2 2023-02-15 02:01:04,205 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba2c16292696f40ac0d6ee553409024d columnFamilyName f2 2023-02-15 02:01:04,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:04,207 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(310): Store=ba2c16292696f40ac0d6ee553409024d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:04,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:04,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d43d8807bc1c0144bcbf7ce1fa4ef60a, NAME => 'testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 02:01:04,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,209 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8bf5e331546fa7419c02dfbb7aeaf1e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:04,209 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464209"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464209"}]},"ts":"1676426464209"} 2023-02-15 02:01:04,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,217 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-15 02:01:04,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 8bf5e331546fa7419c02dfbb7aeaf1e3, server=jenkins-hbase20.apache.org,44999,1676426459385 in 247 msec 2023-02-15 02:01:04,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,220 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1 2023-02-15 02:01:04,221 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1 2023-02-15 02:01:04,222 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d43d8807bc1c0144bcbf7ce1fa4ef60a columnFamilyName f1 2023-02-15 02:01:04,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, ASSIGN in 423 msec 2023-02-15 02:01:04,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:04,223 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(310): Store=d43d8807bc1c0144bcbf7ce1fa4ef60a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,223 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,225 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2 2023-02-15 02:01:04,225 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2 2023-02-15 02:01:04,226 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d43d8807bc1c0144bcbf7ce1fa4ef60a columnFamilyName f2 2023-02-15 02:01:04,226 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(310): Store=d43d8807bc1c0144bcbf7ce1fa4ef60a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ba2c16292696f40ac0d6ee553409024d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74194333, jitterRate=0.10558171570301056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:04,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d., pid=30, masterSystemTime=1676426464130 2023-02-15 02:01:04,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:04,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:04,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8d82f194d69d4ff1d5554e16b717456f, NAME => 'testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 02:01:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:04,240 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ba2c16292696f40ac0d6ee553409024d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:04,240 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464240"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464240"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464240"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464240"}]},"ts":"1676426464240"} 2023-02-15 02:01:04,241 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,245 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1 2023-02-15 02:01:04,245 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1 2023-02-15 02:01:04,246 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d82f194d69d4ff1d5554e16b717456f columnFamilyName f1 2023-02-15 02:01:04,247 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(310): Store=8d82f194d69d4ff1d5554e16b717456f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,247 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,249 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2 2023-02-15 02:01:04,249 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2 2023-02-15 02:01:04,249 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d82f194d69d4ff1d5554e16b717456f columnFamilyName f2 2023-02-15 02:01:04,250 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(310): Store=8d82f194d69d4ff1d5554e16b717456f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-15 02:01:04,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure ba2c16292696f40ac0d6ee553409024d, server=jenkins-hbase20.apache.org,33675,1676426459341 in 257 msec 2023-02-15 02:01:04,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d43d8807bc1c0144bcbf7ce1fa4ef60a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63247580, jitterRate=-0.057537615299224854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a., pid=22, masterSystemTime=1676426464114 2023-02-15 02:01:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:04,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:04,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:04,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:04,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, ASSIGN in 457 msec 2023-02-15 02:01:04,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dadf1f57dfe4b02ed1edf951d27e37e4, NAME => 'testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 02:01:04,261 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d43d8807bc1c0144bcbf7ce1fa4ef60a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:04,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464261"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464261"}]},"ts":"1676426464261"} 2023-02-15 02:01:04,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,266 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,271 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1 2023-02-15 02:01:04,271 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1 2023-02-15 02:01:04,272 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dadf1f57dfe4b02ed1edf951d27e37e4 columnFamilyName f1 2023-02-15 02:01:04,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-15 02:01:04,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure d43d8807bc1c0144bcbf7ce1fa4ef60a, server=jenkins-hbase20.apache.org,44999,1676426459385 in 305 msec 2023-02-15 02:01:04,273 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(310): Store=dadf1f57dfe4b02ed1edf951d27e37e4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,274 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,279 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2 2023-02-15 02:01:04,280 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2 2023-02-15 02:01:04,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8d82f194d69d4ff1d5554e16b717456f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64218178, jitterRate=-0.043074578046798706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, ASSIGN in 478 msec 2023-02-15 02:01:04,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:04,281 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dadf1f57dfe4b02ed1edf951d27e37e4 columnFamilyName f2 2023-02-15 02:01:04,282 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(310): Store=dadf1f57dfe4b02ed1edf951d27e37e4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f., pid=27, masterSystemTime=1676426464130 2023-02-15 02:01:04,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:04,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8d82f194d69d4ff1d5554e16b717456f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:04,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:04,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:04,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464294"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464294"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464294"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464294"}]},"ts":"1676426464294"} 2023-02-15 02:01:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c46656db903b7cf9404e8d31878c69f4, NAME => 'testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 02:01:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:04,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:04,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-15 02:01:04,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 8d82f194d69d4ff1d5554e16b717456f, server=jenkins-hbase20.apache.org,33675,1676426459341 in 323 msec 2023-02-15 02:01:04,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, ASSIGN in 509 msec 2023-02-15 02:01:04,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened dadf1f57dfe4b02ed1edf951d27e37e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65288374, jitterRate=-0.02712741494178772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:04,308 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4., pid=23, masterSystemTime=1676426464114 2023-02-15 02:01:04,311 DEBUG [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f1 2023-02-15 02:01:04,311 DEBUG [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f1 2023-02-15 02:01:04,312 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46656db903b7cf9404e8d31878c69f4 columnFamilyName f1 2023-02-15 02:01:04,313 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(310): Store=c46656db903b7cf9404e8d31878c69f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:04,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:04,313 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 289e79097eeee10570ba41c9e93aede4, NAME => 'testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 02:01:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,315 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dadf1f57dfe4b02ed1edf951d27e37e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:04,315 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464315"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464315"}]},"ts":"1676426464315"} 2023-02-15 02:01:04,316 DEBUG [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f2 2023-02-15 02:01:04,316 DEBUG [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f2 2023-02-15 02:01:04,317 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46656db903b7cf9404e8d31878c69f4 columnFamilyName f2 2023-02-15 02:01:04,317 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,318 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(310): Store=c46656db903b7cf9404e8d31878c69f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,325 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1 2023-02-15 02:01:04,325 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1 2023-02-15 02:01:04,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-15 02:01:04,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure dadf1f57dfe4b02ed1edf951d27e37e4, server=jenkins-hbase20.apache.org,44999,1676426459385 in 358 msec 2023-02-15 02:01:04,326 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 289e79097eeee10570ba41c9e93aede4 columnFamilyName f1 2023-02-15 02:01:04,328 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(310): Store=289e79097eeee10570ba41c9e93aede4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,329 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, ASSIGN in 531 msec 2023-02-15 02:01:04,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:04,332 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2 2023-02-15 02:01:04,332 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2 2023-02-15 02:01:04,332 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 289e79097eeee10570ba41c9e93aede4 columnFamilyName f2 2023-02-15 02:01:04,333 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(310): Store=289e79097eeee10570ba41c9e93aede4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened c46656db903b7cf9404e8d31878c69f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71938015, jitterRate=0.0719599574804306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:04,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4., pid=26, masterSystemTime=1676426464130 2023-02-15 02:01:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 289e79097eeee10570ba41c9e93aede4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62240987, jitterRate=-0.07253701984882355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:04,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:04,356 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c46656db903b7cf9404e8d31878c69f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:04,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4., pid=21, masterSystemTime=1676426464114 2023-02-15 02:01:04,357 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426464356"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464356"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464356"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464356"}]},"ts":"1676426464356"} 2023-02-15 02:01:04,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:04,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:04,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8683f26dde3a7c4fce3afc36e3dd7b00, NAME => 'testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 02:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:04,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=289e79097eeee10570ba41c9e93aede4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:04,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464361"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464361"}]},"ts":"1676426464361"} 2023-02-15 02:01:04,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-15 02:01:04,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure c46656db903b7cf9404e8d31878c69f4, server=jenkins-hbase20.apache.org,33675,1676426459341 in 387 msec 2023-02-15 02:01:04,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, ASSIGN in 569 msec 2023-02-15 02:01:04,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-15 02:01:04,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 289e79097eeee10570ba41c9e93aede4, server=jenkins-hbase20.apache.org,44999,1676426459385 in 405 msec 2023-02-15 02:01:04,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, ASSIGN in 575 msec 2023-02-15 02:01:04,374 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,377 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1 2023-02-15 02:01:04,377 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1 2023-02-15 02:01:04,378 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8683f26dde3a7c4fce3afc36e3dd7b00 columnFamilyName f1 2023-02-15 02:01:04,379 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(310): Store=8683f26dde3a7c4fce3afc36e3dd7b00/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,379 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,381 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2 2023-02-15 02:01:04,381 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2 2023-02-15 02:01:04,381 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8683f26dde3a7c4fce3afc36e3dd7b00 columnFamilyName f2 2023-02-15 02:01:04,382 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(310): Store=8683f26dde3a7c4fce3afc36e3dd7b00/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:04,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:04,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:04,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:04,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8683f26dde3a7c4fce3afc36e3dd7b00; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64891121, jitterRate=-0.03304694592952728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:04,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:04,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00., pid=28, masterSystemTime=1676426464130 2023-02-15 02:01:04,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:04,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:04,395 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8683f26dde3a7c4fce3afc36e3dd7b00, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:04,395 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426464395"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426464395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426464395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426464395"}]},"ts":"1676426464395"} 2023-02-15 02:01:04,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-15 02:01:04,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 8683f26dde3a7c4fce3afc36e3dd7b00, server=jenkins-hbase20.apache.org,33675,1676426459341 in 420 msec 2023-02-15 02:01:04,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-02-15 02:01:04,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, ASSIGN in 607 msec 2023-02-15 02:01:04,408 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:04,408 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426464408"}]},"ts":"1676426464408"} 2023-02-15 02:01:04,410 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 02:01:04,413 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:04,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2530 sec 2023-02-15 02:01:05,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:05,305 INFO [Listener at localhost.localdomain/44729] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 02:01:05,305 DEBUG [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 02:01:05,307 INFO [Listener at localhost.localdomain/44729] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:05,316 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 02:01:05,317 INFO [Listener at localhost.localdomain/44729] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:05,317 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 02:01:05,317 INFO [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:05,433 DEBUG [hconnection-0x4a730f0f-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:05,479 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:05,503 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33675] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:05,515 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44999] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:05,802 INFO [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:05,805 INFO [Listener at localhost.localdomain/44729] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:05,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:05,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426465818 (current time:1676426465818). 2023-02-15 02:01:05,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] zookeeper.ReadOnlyZKClient(139): Connect 0x365148ab to 127.0.0.1:50976 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:05,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24edd58b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:05,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:05,830 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:05,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x365148ab to 127.0.0.1:50976 2023-02-15 02:01:05,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:05,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:05,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:05,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:05,851 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:05,853 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676427065853 2023-02-15 02:01:05,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:05,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 02:01:05,856 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:05,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:05,860 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:05,860 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:05,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 12 msec 2023-02-15 02:01:05,861 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:05,862 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676427065862 2023-02-15 02:01:05,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-15 02:01:05,897 INFO [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-15 02:01:05,897 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:05,897 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-15 02:01:05,897 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 02:01:05,898 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:05,898 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:05,899 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:05,899 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:05,899 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:05,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:05,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:05,900 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,900 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:05,900 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:05,900 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:05,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 02:01:05,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 02:01:05,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 02:01:05,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 02:01:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 02:01:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 02:01:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 02:01:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 02:01:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 02:01:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 02:01:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33675,1676426459341' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 02:01:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44999,1676426459385' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 02:01:05,916 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,916 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:05,916 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,916 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,917 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,917 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:05,917 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,917 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:05,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44999,1676426459385' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 02:01:05,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56d81ab3[Count = 1] remaining members to acquire global barrier 2023-02-15 02:01:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:05,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33675,1676426459341' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 02:01:05,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56d81ab3[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:05,921 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 02:01:05,921 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:05,923 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:05,923 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:05,923 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:05,924 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:05,924 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:05,931 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:05,931 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:05,932 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. started... 2023-02-15 02:01:05,932 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. started... 2023-02-15 02:01:05,933 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 289e79097eeee10570ba41c9e93aede4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:05,933 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8683f26dde3a7c4fce3afc36e3dd7b00 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:05,933 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:05,933 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. started... 2023-02-15 02:01:05,933 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 02:01:05,933 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:05,935 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:05,935 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:05,935 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 02:01:05,935 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:05,935 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. started... 2023-02-15 02:01:05,935 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. started... 2023-02-15 02:01:05,936 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:05,940 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegion(2744): Flushing dadf1f57dfe4b02ed1edf951d27e37e4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:05,936 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6b9fd63d89233bbf287c4ca3eb70a65a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 02:01:05,941 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:05,942 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. started... 2023-02-15 02:01:05,942 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:05,942 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:05,951 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:05,955 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:05,957 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:05,959 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:05,959 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:05,960 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:05,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:05,959 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:05,966 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:05,966 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:06,012 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. completed. 2023-02-15 02:01:06,013 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:06,014 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:06,014 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 02:01:06,014 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. started... 2023-02-15 02:01:06,017 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ba2c16292696f40ac0d6ee553409024d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:06,034 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. completed. 2023-02-15 02:01:06,034 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:06,035 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:06,035 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 02:01:06,039 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. started... 2023-02-15 02:01:06,040 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8d82f194d69d4ff1d5554e16b717456f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:06,144 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f1/bf68242c7c8649d5ad51a9694644ed52 2023-02-15 02:01:06,148 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f1/1310f306f8b94162b7ef535022d244ba 2023-02-15 02:01:06,161 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f1/4545a52981e9466babcc183fb542cda8 2023-02-15 02:01:06,166 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:06,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:06,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:06,168 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 02:01:06,172 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f1/96dda6f69c7d4ac6969ef81e3062ec5e 2023-02-15 02:01:06,181 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f1/f5d1cfdb911c41cd98d038d0208a2467 2023-02-15 02:01:06,279 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f2/0251d90b94c34591bf3a1f953982cf90 2023-02-15 02:01:06,283 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f2/783808553fce4ae6906a80f19600064c 2023-02-15 02:01:06,283 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f2/99452c04f4fd48e291adc83cabf9263c 2023-02-15 02:01:06,292 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f1/4545a52981e9466babcc183fb542cda8 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/4545a52981e9466babcc183fb542cda8 2023-02-15 02:01:06,292 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f1/f5d1cfdb911c41cd98d038d0208a2467 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/f5d1cfdb911c41cd98d038d0208a2467 2023-02-15 02:01:06,296 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f2/c7df3d1e74c540c79a2ac1feb3f3f3af 2023-02-15 02:01:06,299 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f1/1310f306f8b94162b7ef535022d244ba as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/1310f306f8b94162b7ef535022d244ba 2023-02-15 02:01:06,304 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/4545a52981e9466babcc183fb542cda8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,304 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/f5d1cfdb911c41cd98d038d0208a2467, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,306 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f2/783808553fce4ae6906a80f19600064c as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/783808553fce4ae6906a80f19600064c 2023-02-15 02:01:06,307 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f2/0251d90b94c34591bf3a1f953982cf90 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/0251d90b94c34591bf3a1f953982cf90 2023-02-15 02:01:06,307 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f1/96dda6f69c7d4ac6969ef81e3062ec5e as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/96dda6f69c7d4ac6969ef81e3062ec5e 2023-02-15 02:01:06,309 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/1310f306f8b94162b7ef535022d244ba, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:06,311 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f2/99452c04f4fd48e291adc83cabf9263c as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/99452c04f4fd48e291adc83cabf9263c 2023-02-15 02:01:06,315 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/0251d90b94c34591bf3a1f953982cf90, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,316 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/96dda6f69c7d4ac6969ef81e3062ec5e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,316 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/783808553fce4ae6906a80f19600064c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,317 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f2/c7df3d1e74c540c79a2ac1feb3f3f3af as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/c7df3d1e74c540c79a2ac1feb3f3f3af 2023-02-15 02:01:06,317 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ba2c16292696f40ac0d6ee553409024d in 300ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,319 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 02:01:06,321 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:06,321 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,321 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,321 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8683f26dde3a7c4fce3afc36e3dd7b00 in 388ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,321 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/4545a52981e9466babcc183fb542cda8] hfiles 2023-02-15 02:01:06,322 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:06,322 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/4545a52981e9466babcc183fb542cda8 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,322 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/99452c04f4fd48e291adc83cabf9263c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:06,322 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,322 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,322 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/f5d1cfdb911c41cd98d038d0208a2467] hfiles 2023-02-15 02:01:06,322 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/f5d1cfdb911c41cd98d038d0208a2467 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,323 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6b9fd63d89233bbf287c4ca3eb70a65a in 388ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,323 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:06,324 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,324 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,324 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/1310f306f8b94162b7ef535022d244ba] hfiles 2023-02-15 02:01:06,324 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/1310f306f8b94162b7ef535022d244ba for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,326 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/c7df3d1e74c540c79a2ac1feb3f3f3af, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/783808553fce4ae6906a80f19600064c] hfiles 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/783808553fce4ae6906a80f19600064c for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/0251d90b94c34591bf3a1f953982cf90] hfiles 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/99452c04f4fd48e291adc83cabf9263c] hfiles 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/0251d90b94c34591bf3a1f953982cf90 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/99452c04f4fd48e291adc83cabf9263c for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,327 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for dadf1f57dfe4b02ed1edf951d27e37e4 in 388ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,327 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:06,328 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,328 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,328 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/96dda6f69c7d4ac6969ef81e3062ec5e] hfiles 2023-02-15 02:01:06,328 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/96dda6f69c7d4ac6969ef81e3062ec5e for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,328 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/c7df3d1e74c540c79a2ac1feb3f3f3af] hfiles 2023-02-15 02:01:06,328 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/c7df3d1e74c540c79a2ac1feb3f3f3af for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,347 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. completed. 2023-02-15 02:01:06,347 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:06,347 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:06,347 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 02:01:06,347 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. completed. 2023-02-15 02:01:06,347 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:06,347 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. started... 2023-02-15 02:01:06,347 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 02:01:06,348 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d43d8807bc1c0144bcbf7ce1fa4ef60a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:06,349 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. completed. 2023-02-15 02:01:06,349 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:06,349 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:06,349 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 02:01:06,349 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. started... 2023-02-15 02:01:06,350 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8bf5e331546fa7419c02dfbb7aeaf1e3 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 02:01:06,350 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. completed. 2023-02-15 02:01:06,350 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:06,350 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 02:01:06,381 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f1/8099acbb499444e485172ff9c52de211 2023-02-15 02:01:06,382 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f1/7c5297669bf6410281caa150beb1a613 2023-02-15 02:01:06,409 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f2/5559867ca2b4465bbbb8e95df46ee941 2023-02-15 02:01:06,412 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f2/5b195e9942f44596965275c165b059e1 2023-02-15 02:01:06,417 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f1/7c5297669bf6410281caa150beb1a613 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/7c5297669bf6410281caa150beb1a613 2023-02-15 02:01:06,418 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f1/8099acbb499444e485172ff9c52de211 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/8099acbb499444e485172ff9c52de211 2023-02-15 02:01:06,425 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/7c5297669bf6410281caa150beb1a613, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,425 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/8099acbb499444e485172ff9c52de211, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:06,426 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f2/5559867ca2b4465bbbb8e95df46ee941 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5559867ca2b4465bbbb8e95df46ee941 2023-02-15 02:01:06,426 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f2/5b195e9942f44596965275c165b059e1 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/5b195e9942f44596965275c165b059e1 2023-02-15 02:01:06,434 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5559867ca2b4465bbbb8e95df46ee941, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,435 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d43d8807bc1c0144bcbf7ce1fa4ef60a in 87ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,435 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:06,436 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,436 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,436 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/7c5297669bf6410281caa150beb1a613] hfiles 2023-02-15 02:01:06,436 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/7c5297669bf6410281caa150beb1a613 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,436 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5559867ca2b4465bbbb8e95df46ee941] hfiles 2023-02-15 02:01:06,436 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5559867ca2b4465bbbb8e95df46ee941 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,440 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/5b195e9942f44596965275c165b059e1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:06,441 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8bf5e331546fa7419c02dfbb7aeaf1e3 in 91ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,441 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/8099acbb499444e485172ff9c52de211] hfiles 2023-02-15 02:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/8099acbb499444e485172ff9c52de211 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/5b195e9942f44596965275c165b059e1] hfiles 2023-02-15 02:01:06,442 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/5b195e9942f44596965275c165b059e1 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,455 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. completed. 2023-02-15 02:01:06,455 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:06,455 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 02:01:06,458 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. completed. 2023-02-15 02:01:06,458 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:06,458 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 02:01:06,468 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:06,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:06,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:06,470 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 02:01:06,573 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f1/55e5bdecf5b246c8abd5c339b7cb4bde 2023-02-15 02:01:06,592 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f2/4c39582049ae40a99a5803ca3bcbb119 2023-02-15 02:01:06,601 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f1/55e5bdecf5b246c8abd5c339b7cb4bde as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/55e5bdecf5b246c8abd5c339b7cb4bde 2023-02-15 02:01:06,610 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/55e5bdecf5b246c8abd5c339b7cb4bde, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,611 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f2/4c39582049ae40a99a5803ca3bcbb119 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/4c39582049ae40a99a5803ca3bcbb119 2023-02-15 02:01:06,620 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/4c39582049ae40a99a5803ca3bcbb119, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,621 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8d82f194d69d4ff1d5554e16b717456f in 582ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/55e5bdecf5b246c8abd5c339b7cb4bde] hfiles 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/55e5bdecf5b246c8abd5c339b7cb4bde for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/4c39582049ae40a99a5803ca3bcbb119] hfiles 2023-02-15 02:01:06,621 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/4c39582049ae40a99a5803ca3bcbb119 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,630 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. completed. 2023-02-15 02:01:06,630 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:06,630 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 02:01:06,630 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 02:01:06,631 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,631 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 02:01:06,631 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,33675,1676426459341' in zk 2023-02-15 02:01:06,633 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,633 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 02:01:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:06,634 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:06,634 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 02:01:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,33675,1676426459341': 2023-02-15 02:01:06,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33675,1676426459341' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 02:01:06,683 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f2/4637a1b243034bfa8e29f210ecb5b572 2023-02-15 02:01:06,699 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f1/bf68242c7c8649d5ad51a9694644ed52 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/bf68242c7c8649d5ad51a9694644ed52 2023-02-15 02:01:06,721 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/bf68242c7c8649d5ad51a9694644ed52, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,722 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f2/4637a1b243034bfa8e29f210ecb5b572 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/4637a1b243034bfa8e29f210ecb5b572 2023-02-15 02:01:06,731 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/4637a1b243034bfa8e29f210ecb5b572, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:06,732 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 289e79097eeee10570ba41c9e93aede4 in 799ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:06,732 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:06,732 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,733 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:06,733 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/bf68242c7c8649d5ad51a9694644ed52] hfiles 2023-02-15 02:01:06,733 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/bf68242c7c8649d5ad51a9694644ed52 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,733 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/4637a1b243034bfa8e29f210ecb5b572] hfiles 2023-02-15 02:01:06,733 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/4637a1b243034bfa8e29f210ecb5b572 for snapshot=testWithMapReduceMultiRegion 2023-02-15 02:01:06,741 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. completed. 2023-02-15 02:01:06,741 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 02:01:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 02:01:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 02:01:06,741 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,44999,1676426459385' in zk 2023-02-15 02:01:06,743 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,743 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 02:01:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:06,743 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:06,743 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 02:01:06,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,44999,1676426459385': 2023-02-15 02:01:06,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44999,1676426459385' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:06,748 INFO [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-15 02:01:06,748 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:06,748 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:06,748 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-15 02:01:06,748 INFO [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:06,753 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:06,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,753 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:06,754 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:06,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:06,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,755 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,757 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:06,757 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 02:01:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,767 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:06,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:06,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:06,768 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:06,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-15 02:01:06,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:06,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:06,768 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 02:01:06,769 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:06,769 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:06,769 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:06,769 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 02:01:06,769 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 02:01:06,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:06,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:06,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 02:01:06,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-15 02:01:06,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-15 02:01:06,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 02:01:06,881 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 02:01:06,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676426465854Consolidate snapshot: testWithMapReduceMultiRegion at 1676426466768 (+914 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676426466768Writing data manifest for testWithMapReduceMultiRegion at 1676426466798 (+30 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676426466818 (+20 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676426466880 (+62 ms) 2023-02-15 02:01:06,882 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:06,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0270 sec 2023-02-15 02:01:06,970 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:06,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:06,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:06,973 INFO [Listener at localhost.localdomain/44729] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:06,985 INFO [Listener at localhost.localdomain/44729] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:06,999 INFO [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:07,079 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33675] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:07,103 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44999] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:07,302 INFO [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:07,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:07,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 02:01:07,335 INFO [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 02:01:07,335 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:07,336 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 02:01:07,336 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 02:01:07,337 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:07,337 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:07,338 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:07,338 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:07,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:07,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:07,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 02:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:07,343 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:07,343 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 02:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 02:01:07,343 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:07,343 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:07,344 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:07,344 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:07,349 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 02:01:07,349 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 02:01:07,350 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:07,350 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 02:01:07,350 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 02:01:07,350 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:07,351 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. started... 2023-02-15 02:01:07,352 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8683f26dde3a7c4fce3afc36e3dd7b00 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. started... 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. started... 2023-02-15 02:01:07,352 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. started... 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. started... 2023-02-15 02:01:07,353 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:07,352 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 289e79097eeee10570ba41c9e93aede4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:07,353 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 02:01:07,353 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. started... 2023-02-15 02:01:07,353 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6b9fd63d89233bbf287c4ca3eb70a65a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 02:01:07,353 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:07,357 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 02:01:07,357 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 02:01:07,357 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:07,357 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. started... 2023-02-15 02:01:07,353 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ba2c16292696f40ac0d6ee553409024d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:07,353 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:07,358 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. started... 2023-02-15 02:01:07,358 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8d82f194d69d4ff1d5554e16b717456f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:07,359 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dadf1f57dfe4b02ed1edf951d27e37e4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:07,449 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f1/dd853fda7f2c4cae9685c669587ab504 2023-02-15 02:01:07,479 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f1/5f74277b74dc4c11b7cafffef2f5bee5 2023-02-15 02:01:07,479 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f1/d0b04c4625ff4f1a8032af5be1472d26 2023-02-15 02:01:07,506 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f2/2cf26a3993a0459a8e1133348ae395da 2023-02-15 02:01:07,514 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f1/dd853fda7f2c4cae9685c669587ab504 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/dd853fda7f2c4cae9685c669587ab504 2023-02-15 02:01:07,522 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/dd853fda7f2c4cae9685c669587ab504, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,523 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/.tmp/f2/2cf26a3993a0459a8e1133348ae395da as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/2cf26a3993a0459a8e1133348ae395da 2023-02-15 02:01:07,527 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f2/377716ce890d40c4957f797d937369c8 2023-02-15 02:01:07,530 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f2/bd4d392d654f41a389a26e337781a27c 2023-02-15 02:01:07,536 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/2cf26a3993a0459a8e1133348ae395da, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,537 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8683f26dde3a7c4fce3afc36e3dd7b00 in 185ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,537 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:07,537 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:07,537 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 02:01:07,539 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f1/5f74277b74dc4c11b7cafffef2f5bee5 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/5f74277b74dc4c11b7cafffef2f5bee5 2023-02-15 02:01:07,541 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f1/d0b04c4625ff4f1a8032af5be1472d26 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/d0b04c4625ff4f1a8032af5be1472d26 2023-02-15 02:01:07,548 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/d0b04c4625ff4f1a8032af5be1472d26, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,548 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/5f74277b74dc4c11b7cafffef2f5bee5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,549 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/.tmp/f2/bd4d392d654f41a389a26e337781a27c as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/bd4d392d654f41a389a26e337781a27c 2023-02-15 02:01:07,549 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/.tmp/f2/377716ce890d40c4957f797d937369c8 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/377716ce890d40c4957f797d937369c8 2023-02-15 02:01:07,557 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/377716ce890d40c4957f797d937369c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,557 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/bd4d392d654f41a389a26e337781a27c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,558 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 289e79097eeee10570ba41c9e93aede4 in 206ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,558 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:07,558 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:07,558 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:07,558 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 02:01:07,559 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8d82f194d69d4ff1d5554e16b717456f in 200ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,559 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:07,559 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:07,558 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. started... 2023-02-15 02:01:07,559 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 02:01:07,559 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d43d8807bc1c0144bcbf7ce1fa4ef60a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:07,575 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f1/6f3c6795f61d4f64a42c8286841844f8 2023-02-15 02:01:07,590 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-15 02:01:07,598 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f2/5db5a3b7a73b4038894a85b4e3ee4e5a 2023-02-15 02:01:07,611 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f1/6f3c6795f61d4f64a42c8286841844f8 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/6f3c6795f61d4f64a42c8286841844f8 2023-02-15 02:01:07,619 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/6f3c6795f61d4f64a42c8286841844f8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,621 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/.tmp/f2/5db5a3b7a73b4038894a85b4e3ee4e5a as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5db5a3b7a73b4038894a85b4e3ee4e5a 2023-02-15 02:01:07,631 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5db5a3b7a73b4038894a85b4e3ee4e5a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,633 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d43d8807bc1c0144bcbf7ce1fa4ef60a in 73ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,633 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:07,633 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:07,633 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:07,633 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 02:01:07,633 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. started... 2023-02-15 02:01:07,633 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8bf5e331546fa7419c02dfbb7aeaf1e3 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 02:01:07,670 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f1/c4d5accdadab4b95b561171780b4de34 2023-02-15 02:01:07,681 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 02:01:07,683 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 02:01:07,706 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f2/38d7358348b74aa488501dc2675eccad 2023-02-15 02:01:07,713 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f1/c4d5accdadab4b95b561171780b4de34 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/c4d5accdadab4b95b561171780b4de34 2023-02-15 02:01:07,719 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/c4d5accdadab4b95b561171780b4de34, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:07,720 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/.tmp/f2/38d7358348b74aa488501dc2675eccad as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/38d7358348b74aa488501dc2675eccad 2023-02-15 02:01:07,726 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/38d7358348b74aa488501dc2675eccad, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:07,727 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8bf5e331546fa7419c02dfbb7aeaf1e3 in 94ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,727 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:07,727 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:07,727 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 02:01:07,851 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f1/2fac720e5440405c978d3f9dae82b9e3 2023-02-15 02:01:07,851 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f1/39a895f331444ee987b93510ed7b165b 2023-02-15 02:01:07,883 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f1/c3bc6131362a48158f93918dd5ba494e 2023-02-15 02:01:07,884 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f2/17b9ab8efdb046c395334323976568c2 2023-02-15 02:01:07,893 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f1/2fac720e5440405c978d3f9dae82b9e3 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/2fac720e5440405c978d3f9dae82b9e3 2023-02-15 02:01:07,900 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/2fac720e5440405c978d3f9dae82b9e3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,901 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/.tmp/f2/17b9ab8efdb046c395334323976568c2 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/17b9ab8efdb046c395334323976568c2 2023-02-15 02:01:07,903 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f2/bf848a47affe47ad86311716be53b473 2023-02-15 02:01:07,908 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/17b9ab8efdb046c395334323976568c2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:07,909 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for dadf1f57dfe4b02ed1edf951d27e37e4 in 550ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,909 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:07,909 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:07,909 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 02:01:07,910 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f1/c3bc6131362a48158f93918dd5ba494e as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/c3bc6131362a48158f93918dd5ba494e 2023-02-15 02:01:07,915 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/c3bc6131362a48158f93918dd5ba494e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:07,916 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/.tmp/f2/bf848a47affe47ad86311716be53b473 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/bf848a47affe47ad86311716be53b473 2023-02-15 02:01:07,921 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/bf848a47affe47ad86311716be53b473, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:07,922 INFO [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6b9fd63d89233bbf287c4ca3eb70a65a in 569ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:07,922 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:07,922 DEBUG [rs(jenkins-hbase20.apache.org,44999,1676426459385)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:07,923 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 02:01:07,923 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 02:01:07,923 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:07,923 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 02:01:07,923 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44999,1676426459385' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 02:01:07,925 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:07,925 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:07,925 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:07,925 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:07,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44999,1676426459385' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 02:01:07,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f3fdf0[Count = 1] remaining members to acquire global barrier 2023-02-15 02:01:08,283 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f2/bcc056de454147ad969b479972cfb9ba 2023-02-15 02:01:08,289 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f1/39a895f331444ee987b93510ed7b165b as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/39a895f331444ee987b93510ed7b165b 2023-02-15 02:01:08,293 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/39a895f331444ee987b93510ed7b165b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:08,294 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/.tmp/f2/bcc056de454147ad969b479972cfb9ba as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/bcc056de454147ad969b479972cfb9ba 2023-02-15 02:01:08,299 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/bcc056de454147ad969b479972cfb9ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:08,301 INFO [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ba2c16292696f40ac0d6ee553409024d in 948ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:08,301 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:08,301 DEBUG [rs(jenkins-hbase20.apache.org,33675,1676426459341)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 02:01:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 02:01:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 02:01:08,301 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33675,1676426459341' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 02:01:08,302 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:08,303 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:08,303 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,303 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:08,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33675,1676426459341' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 02:01:08,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f3fdf0[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:08,305 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 02:01:08,305 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,306 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,306 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,307 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 02:01:08,307 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 02:01:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,307 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,44999,1676426459385' in zk 2023-02-15 02:01:08,307 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 02:01:08,307 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 02:01:08,307 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,33675,1676426459341' in zk 2023-02-15 02:01:08,307 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,308 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,308 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:08,308 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 02:01:08,308 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,308 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:08,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:08,308 DEBUG [member: 'jenkins-hbase20.apache.org,44999,1676426459385' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 02:01:08,309 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:08,309 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 02:01:08,309 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:08,309 DEBUG [member: 'jenkins-hbase20.apache.org,33675,1676426459341' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 02:01:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:08,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,44999,1676426459385': 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44999,1676426459385' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:08,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,33675,1676426459341': 2023-02-15 02:01:08,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33675,1676426459341' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 02:01:08,318 INFO [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 02:01:08,318 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:08,318 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:08,318 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 02:01:08,318 INFO [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:08,322 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,322 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:08,322 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:08,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,324 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,325 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:08,326 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:08,327 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:08,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:08,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:08,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:08,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:08,336 DEBUG [(jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:08,336 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:08,337 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:08,337 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:08,337 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,337 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:08,337 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:08,337 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:08,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:08,339 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:08,339 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:08,432 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:08,432 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-15 02:01:08,439 DEBUG [Listener at localhost.localdomain/44729] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:08,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:08,540 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop-3873911264956393659.jar 2023-02-15 02:01:08,557 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676426465818 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:08,558 DEBUG [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce 2023-02-15 02:01:08,559 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:08,560 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(239): region to add: 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=8683f26dde3a7c4fce3afc36e3dd7b00 as 8683f26dde3a7c4fce3afc36e3dd7b00 in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=289e79097eeee10570ba41c9e93aede4 as 289e79097eeee10570ba41c9e93aede4 in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=c46656db903b7cf9404e8d31878c69f4 as c46656db903b7cf9404e8d31878c69f4 in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=6b9fd63d89233bbf287c4ca3eb70a65a as 6b9fd63d89233bbf287c4ca3eb70a65a in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=80e0322f2d623adea82dcbb185d7cb08 as 80e0322f2d623adea82dcbb185d7cb08 in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,561 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=dadf1f57dfe4b02ed1edf951d27e37e4 as dadf1f57dfe4b02ed1edf951d27e37e4 in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,562 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=8d82f194d69d4ff1d5554e16b717456f as 8d82f194d69d4ff1d5554e16b717456f in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,562 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=ba2c16292696f40ac0d6ee553409024d as ba2c16292696f40ac0d6ee553409024d in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,562 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=d43d8807bc1c0144bcbf7ce1fa4ef60a as d43d8807bc1c0144bcbf7ce1fa4ef60a in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,562 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(585): clone region=8bf5e331546fa7419c02dfbb7aeaf1e3 as 8bf5e331546fa7419c02dfbb7aeaf1e3 in snapshot testWithMapReduceMultiRegion 2023-02-15 02:01:08,566 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => dadf1f57dfe4b02ed1edf951d27e37e4, NAME => 'testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,566 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6b9fd63d89233bbf287c4ca3eb70a65a, NAME => 'testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,567 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 289e79097eeee10570ba41c9e93aede4, NAME => 'testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,567 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 80e0322f2d623adea82dcbb185d7cb08, NAME => 'testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,567 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c46656db903b7cf9404e8d31878c69f4, NAME => 'testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,568 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 8d82f194d69d4ff1d5554e16b717456f, NAME => 'testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,568 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ba2c16292696f40ac0d6ee553409024d, NAME => 'testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,568 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8683f26dde3a7c4fce3afc36e3dd7b00, NAME => 'testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,578 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,578 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96dda6f69c7d4ac6969ef81e3062ec5e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,595 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,595 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4545a52981e9466babcc183fb542cda8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,598 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7df3d1e74c540c79a2ac1feb3f3f3af from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,602 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,602 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bf68242c7c8649d5ad51a9694644ed52 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,607 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,608 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 80e0322f2d623adea82dcbb185d7cb08, disabling compactions & flushes 2023-02-15 02:01:08,608 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:08,608 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 783808553fce4ae6906a80f19600064c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,608 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4637a1b243034bfa8e29f210ecb5b572 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,608 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing dadf1f57dfe4b02ed1edf951d27e37e4, disabling compactions & flushes 2023-02-15 02:01:08,609 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:08,608 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. after waiting 0 ms 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. after waiting 0 ms 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:08,609 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:08,609 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:08,609 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:08,610 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d43d8807bc1c0144bcbf7ce1fa4ef60a, NAME => 'testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,610 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8bf5e331546fa7419c02dfbb7aeaf1e3, NAME => 'testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,610 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f5d1cfdb911c41cd98d038d0208a2467 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,612 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ba2c16292696f40ac0d6ee553409024d, disabling compactions & flushes 2023-02-15 02:01:08,612 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:08,612 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:08,612 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. after waiting 0 ms 2023-02-15 02:01:08,613 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:08,613 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:08,613 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,614 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1310f306f8b94162b7ef535022d244ba from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,614 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 55e5bdecf5b246c8abd5c339b7cb4bde from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c46656db903b7cf9404e8d31878c69f4, disabling compactions & flushes 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 289e79097eeee10570ba41c9e93aede4, disabling compactions & flushes 2023-02-15 02:01:08,614 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. after waiting 0 ms 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:08,614 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:08,614 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:08,614 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. after waiting 0 ms 2023-02-15 02:01:08,615 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:08,615 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:08,615 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:08,622 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0251d90b94c34591bf3a1f953982cf90 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,626 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 99452c04f4fd48e291adc83cabf9263c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,626 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,626 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7c5297669bf6410281caa150beb1a613 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,626 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4c39582049ae40a99a5803ca3bcbb119 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,629 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 8683f26dde3a7c4fce3afc36e3dd7b00, disabling compactions & flushes 2023-02-15 02:01:08,629 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:08,629 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:08,629 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. after waiting 0 ms 2023-02-15 02:01:08,629 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:08,629 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:08,629 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:08,630 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5559867ca2b4465bbbb8e95df46ee941 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,630 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:08,630 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8099acbb499444e485172ff9c52de211 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6b9fd63d89233bbf287c4ca3eb70a65a, disabling compactions & flushes 2023-02-15 02:01:08,633 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. after waiting 0 ms 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:08,633 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 8d82f194d69d4ff1d5554e16b717456f, disabling compactions & flushes 2023-02-15 02:01:08,633 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b195e9942f44596965275c165b059e1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 02:01:08,633 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:08,633 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. after waiting 0 ms 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d43d8807bc1c0144bcbf7ce1fa4ef60a, disabling compactions & flushes 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:08,634 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:08,634 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. after waiting 0 ms 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:08,634 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:08,634 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:08,635 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8bf5e331546fa7419c02dfbb7aeaf1e3, disabling compactions & flushes 2023-02-15 02:01:08,635 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:08,635 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:08,636 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. after waiting 0 ms 2023-02-15 02:01:08,636 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:08,636 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:08,636 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:08,636 INFO [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676426465818 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:08,636 DEBUG [Listener at localhost.localdomain/44729] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,636 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4 2023-02-15 02:01:08,637 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:08,637 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:08,637 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 02:01:08,638 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------289e79097eeee10570ba41c9e93aede4/ 2023-02-15 02:01:08,638 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,639 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,639 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=289e79097eeee10570ba41c9e93aede4-bf68242c7c8649d5ad51a9694644ed52 2023-02-15 02:01:08,639 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,639 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=289e79097eeee10570ba41c9e93aede4-4637a1b243034bfa8e29f210ecb5b572 2023-02-15 02:01:08,639 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------6b9fd63d89233bbf287c4ca3eb70a65a/ 2023-02-15 02:01:08,640 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,640 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,640 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=6b9fd63d89233bbf287c4ca3eb70a65a-1310f306f8b94162b7ef535022d244ba 2023-02-15 02:01:08,640 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,641 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=6b9fd63d89233bbf287c4ca3eb70a65a-99452c04f4fd48e291adc83cabf9263c 2023-02-15 02:01:08,641 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------80e0322f2d623adea82dcbb185d7cb08/ 2023-02-15 02:01:08,641 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,641 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------8683f26dde3a7c4fce3afc36e3dd7b00/ 2023-02-15 02:01:08,642 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,642 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,642 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=8683f26dde3a7c4fce3afc36e3dd7b00-f5d1cfdb911c41cd98d038d0208a2467 2023-02-15 02:01:08,643 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,643 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=8683f26dde3a7c4fce3afc36e3dd7b00-0251d90b94c34591bf3a1f953982cf90 2023-02-15 02:01:08,643 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------8bf5e331546fa7419c02dfbb7aeaf1e3/ 2023-02-15 02:01:08,644 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,644 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,644 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=8bf5e331546fa7419c02dfbb7aeaf1e3-8099acbb499444e485172ff9c52de211 2023-02-15 02:01:08,644 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,645 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=8bf5e331546fa7419c02dfbb7aeaf1e3-5b195e9942f44596965275c165b059e1 2023-02-15 02:01:08,645 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------8d82f194d69d4ff1d5554e16b717456f/ 2023-02-15 02:01:08,645 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,645 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,646 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=8d82f194d69d4ff1d5554e16b717456f-55e5bdecf5b246c8abd5c339b7cb4bde 2023-02-15 02:01:08,646 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,646 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=8d82f194d69d4ff1d5554e16b717456f-4c39582049ae40a99a5803ca3bcbb119 2023-02-15 02:01:08,646 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------ba2c16292696f40ac0d6ee553409024d/ 2023-02-15 02:01:08,647 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,647 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,647 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=ba2c16292696f40ac0d6ee553409024d-4545a52981e9466babcc183fb542cda8 2023-02-15 02:01:08,647 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,648 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=ba2c16292696f40ac0d6ee553409024d-783808553fce4ae6906a80f19600064c 2023-02-15 02:01:08,648 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------c46656db903b7cf9404e8d31878c69f4/ 2023-02-15 02:01:08,648 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,648 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------d43d8807bc1c0144bcbf7ce1fa4ef60a/ 2023-02-15 02:01:08,649 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,649 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,650 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=d43d8807bc1c0144bcbf7ce1fa4ef60a-7c5297669bf6410281caa150beb1a613 2023-02-15 02:01:08,650 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,650 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=d43d8807bc1c0144bcbf7ce1fa4ef60a-5559867ca2b4465bbbb8e95df46ee941 2023-02-15 02:01:08,650 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |----------dadf1f57dfe4b02ed1edf951d27e37e4/ 2023-02-15 02:01:08,651 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:08,651 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:08,651 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=dadf1f57dfe4b02ed1edf951d27e37e4-96dda6f69c7d4ac6969ef81e3062ec5e 2023-02-15 02:01:08,651 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:08,652 DEBUG [Listener at localhost.localdomain/44729] util.CommonFSUtils(702): |----------------testWithMapReduce=dadf1f57dfe4b02ed1edf951d27e37e4-c7df3d1e74c540c79a2ac1feb3f3f3af 2023-02-15 02:01:08,659 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:08,660 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:08,661 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:08,661 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,466 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop-6896031908049643824.jar 2023-02-15 02:01:09,467 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,467 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,523 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop-6140443569296234652.jar 2023-02-15 02:01:09,524 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,524 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,524 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,525 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,525 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,526 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,526 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 02:01:09,526 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 02:01:09,527 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 02:01:09,527 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 02:01:09,527 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 02:01:09,528 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 02:01:09,528 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 02:01:09,529 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 02:01:09,529 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 02:01:09,529 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 02:01:09,534 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:09,535 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:09,535 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:09,535 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:09,536 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 02:01:09,592 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop-8933681941924200900.jar 2023-02-15 02:01:09,593 DEBUG [Listener at localhost.localdomain/44729] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 02:01:09,635 WARN [Listener at localhost.localdomain/44729] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 02:01:09,648 WARN [Listener at localhost.localdomain/44729] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-15 02:01:09,660 INFO [Listener at localhost.localdomain/44729] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 02:01:09,965 WARN [Listener at localhost.localdomain/44729] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/mapreduce.cluster.local.dir/1676426469896/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 02:01:09,966 WARN [Listener at localhost.localdomain/44729] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/mapreduce.cluster.local.dir/1676426469896/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 02:01:10,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,105 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,107 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,109 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:10,110 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1 2023-02-15 02:01:10,111 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 289e79097eeee10570ba41c9e93aede4 columnFamilyName f1 2023-02-15 02:01:10,120 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/testWithMapReduce=289e79097eeee10570ba41c9e93aede4-bf68242c7c8649d5ad51a9694644ed52 2023-02-15 02:01:10,121 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(310): Store=289e79097eeee10570ba41c9e93aede4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,121 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:10,122 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2 2023-02-15 02:01:10,123 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 289e79097eeee10570ba41c9e93aede4 columnFamilyName f2 2023-02-15 02:01:10,128 DEBUG [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/testWithMapReduce=289e79097eeee10570ba41c9e93aede4-4637a1b243034bfa8e29f210ecb5b572 2023-02-15 02:01:10,128 INFO [StoreOpener-289e79097eeee10570ba41c9e93aede4-1] regionserver.HStore(310): Store=289e79097eeee10570ba41c9e93aede4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,129 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 289e79097eeee10570ba41c9e93aede4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72512965, jitterRate=0.08052738010883331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:10,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 289e79097eeee10570ba41c9e93aede4, disabling compactions & flushes 2023-02-15 02:01:10,270 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:10,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:10,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. after waiting 0 ms 2023-02-15 02:01:10,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:10,275 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:10,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:10,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,292 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,293 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,296 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:10,298 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1 2023-02-15 02:01:10,299 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b9fd63d89233bbf287c4ca3eb70a65a columnFamilyName f1 2023-02-15 02:01:10,306 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/testWithMapReduce=6b9fd63d89233bbf287c4ca3eb70a65a-1310f306f8b94162b7ef535022d244ba 2023-02-15 02:01:10,307 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(310): Store=6b9fd63d89233bbf287c4ca3eb70a65a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,307 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:10,308 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2 2023-02-15 02:01:10,309 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b9fd63d89233bbf287c4ca3eb70a65a columnFamilyName f2 2023-02-15 02:01:10,315 DEBUG [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/testWithMapReduce=6b9fd63d89233bbf287c4ca3eb70a65a-99452c04f4fd48e291adc83cabf9263c 2023-02-15 02:01:10,316 INFO [StoreOpener-6b9fd63d89233bbf287c4ca3eb70a65a-1] regionserver.HStore(310): Store=6b9fd63d89233bbf287c4ca3eb70a65a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,316 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,317 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6b9fd63d89233bbf287c4ca3eb70a65a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70891168, jitterRate=0.056360721588134766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,317 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:10,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6b9fd63d89233bbf287c4ca3eb70a65a, disabling compactions & flushes 2023-02-15 02:01:10,465 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:10,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:10,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. after waiting 0 ms 2023-02-15 02:01:10,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:10,472 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:10,472 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:10,481 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,481 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,487 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,491 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:10,494 DEBUG [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f1 2023-02-15 02:01:10,494 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80e0322f2d623adea82dcbb185d7cb08 columnFamilyName f1 2023-02-15 02:01:10,495 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(310): Store=80e0322f2d623adea82dcbb185d7cb08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,495 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:10,496 DEBUG [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f2 2023-02-15 02:01:10,497 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80e0322f2d623adea82dcbb185d7cb08 columnFamilyName f2 2023-02-15 02:01:10,498 INFO [StoreOpener-80e0322f2d623adea82dcbb185d7cb08-1] regionserver.HStore(310): Store=80e0322f2d623adea82dcbb185d7cb08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,498 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,498 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 80e0322f2d623adea82dcbb185d7cb08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63322236, jitterRate=-0.05642515420913696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,498 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:10,508 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 80e0322f2d623adea82dcbb185d7cb08, disabling compactions & flushes 2023-02-15 02:01:10,508 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:10,508 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:10,508 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. after waiting 0 ms 2023-02-15 02:01:10,508 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:10,508 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:10,508 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:10,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,514 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,520 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,522 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:10,523 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1 2023-02-15 02:01:10,524 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bf5e331546fa7419c02dfbb7aeaf1e3 columnFamilyName f1 2023-02-15 02:01:10,530 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/testWithMapReduce=8bf5e331546fa7419c02dfbb7aeaf1e3-8099acbb499444e485172ff9c52de211 2023-02-15 02:01:10,531 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(310): Store=8bf5e331546fa7419c02dfbb7aeaf1e3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,531 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:10,532 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2 2023-02-15 02:01:10,533 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bf5e331546fa7419c02dfbb7aeaf1e3 columnFamilyName f2 2023-02-15 02:01:10,540 DEBUG [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/testWithMapReduce=8bf5e331546fa7419c02dfbb7aeaf1e3-5b195e9942f44596965275c165b059e1 2023-02-15 02:01:10,540 INFO [StoreOpener-8bf5e331546fa7419c02dfbb7aeaf1e3-1] regionserver.HStore(310): Store=8bf5e331546fa7419c02dfbb7aeaf1e3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,540 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,541 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8bf5e331546fa7419c02dfbb7aeaf1e3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64607150, jitterRate=-0.037278443574905396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,541 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:10,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8bf5e331546fa7419c02dfbb7aeaf1e3, disabling compactions & flushes 2023-02-15 02:01:10,604 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:10,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:10,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. after waiting 0 ms 2023-02-15 02:01:10,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:10,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:10,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:10,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,619 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,620 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,622 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:10,623 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1 2023-02-15 02:01:10,624 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8683f26dde3a7c4fce3afc36e3dd7b00 columnFamilyName f1 2023-02-15 02:01:10,632 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/testWithMapReduce=8683f26dde3a7c4fce3afc36e3dd7b00-f5d1cfdb911c41cd98d038d0208a2467 2023-02-15 02:01:10,632 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(310): Store=8683f26dde3a7c4fce3afc36e3dd7b00/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,632 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:10,633 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2 2023-02-15 02:01:10,634 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8683f26dde3a7c4fce3afc36e3dd7b00 columnFamilyName f2 2023-02-15 02:01:10,639 DEBUG [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/testWithMapReduce=8683f26dde3a7c4fce3afc36e3dd7b00-0251d90b94c34591bf3a1f953982cf90 2023-02-15 02:01:10,639 INFO [StoreOpener-8683f26dde3a7c4fce3afc36e3dd7b00-1] regionserver.HStore(310): Store=8683f26dde3a7c4fce3afc36e3dd7b00/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,640 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8683f26dde3a7c4fce3afc36e3dd7b00; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63671717, jitterRate=-0.05121748149394989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,640 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:10,668 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8683f26dde3a7c4fce3afc36e3dd7b00, disabling compactions & flushes 2023-02-15 02:01:10,668 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:10,668 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:10,668 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. after waiting 0 ms 2023-02-15 02:01:10,668 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:10,671 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:10,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:10,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,679 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,681 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,683 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:10,684 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1 2023-02-15 02:01:10,685 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dadf1f57dfe4b02ed1edf951d27e37e4 columnFamilyName f1 2023-02-15 02:01:10,701 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/testWithMapReduce=dadf1f57dfe4b02ed1edf951d27e37e4-96dda6f69c7d4ac6969ef81e3062ec5e 2023-02-15 02:01:10,702 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(310): Store=dadf1f57dfe4b02ed1edf951d27e37e4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,702 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:10,703 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2 2023-02-15 02:01:10,704 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dadf1f57dfe4b02ed1edf951d27e37e4 columnFamilyName f2 2023-02-15 02:01:10,712 DEBUG [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/testWithMapReduce=dadf1f57dfe4b02ed1edf951d27e37e4-c7df3d1e74c540c79a2ac1feb3f3f3af 2023-02-15 02:01:10,713 INFO [StoreOpener-dadf1f57dfe4b02ed1edf951d27e37e4-1] regionserver.HStore(310): Store=dadf1f57dfe4b02ed1edf951d27e37e4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,713 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dadf1f57dfe4b02ed1edf951d27e37e4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68472409, jitterRate=0.020318403840065002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:10,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dadf1f57dfe4b02ed1edf951d27e37e4, disabling compactions & flushes 2023-02-15 02:01:10,774 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:10,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:10,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. after waiting 0 ms 2023-02-15 02:01:10,774 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:10,782 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:10,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:10,787 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,787 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,791 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,795 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:10,797 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1 2023-02-15 02:01:10,798 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d82f194d69d4ff1d5554e16b717456f columnFamilyName f1 2023-02-15 02:01:10,809 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/testWithMapReduce=8d82f194d69d4ff1d5554e16b717456f-55e5bdecf5b246c8abd5c339b7cb4bde 2023-02-15 02:01:10,809 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(310): Store=8d82f194d69d4ff1d5554e16b717456f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,809 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:10,811 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2 2023-02-15 02:01:10,811 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d82f194d69d4ff1d5554e16b717456f columnFamilyName f2 2023-02-15 02:01:10,817 DEBUG [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/testWithMapReduce=8d82f194d69d4ff1d5554e16b717456f-4c39582049ae40a99a5803ca3bcbb119 2023-02-15 02:01:10,818 INFO [StoreOpener-8d82f194d69d4ff1d5554e16b717456f-1] regionserver.HStore(310): Store=8d82f194d69d4ff1d5554e16b717456f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,818 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8d82f194d69d4ff1d5554e16b717456f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63996287, jitterRate=-0.046381011605262756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:10,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8d82f194d69d4ff1d5554e16b717456f, disabling compactions & flushes 2023-02-15 02:01:10,841 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:10,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:10,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. after waiting 0 ms 2023-02-15 02:01:10,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:10,848 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:10,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:10,852 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,852 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,854 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,859 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:10,861 DEBUG [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f1 2023-02-15 02:01:10,862 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46656db903b7cf9404e8d31878c69f4 columnFamilyName f1 2023-02-15 02:01:10,862 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(310): Store=c46656db903b7cf9404e8d31878c69f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,862 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:10,864 DEBUG [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f2 2023-02-15 02:01:10,864 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c46656db903b7cf9404e8d31878c69f4 columnFamilyName f2 2023-02-15 02:01:10,865 INFO [StoreOpener-c46656db903b7cf9404e8d31878c69f4-1] regionserver.HStore(310): Store=c46656db903b7cf9404e8d31878c69f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,865 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c46656db903b7cf9404e8d31878c69f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61653449, jitterRate=-0.08129201829433441}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:10,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c46656db903b7cf9404e8d31878c69f4, disabling compactions & flushes 2023-02-15 02:01:10,878 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:10,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:10,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. after waiting 0 ms 2023-02-15 02:01:10,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:10,878 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:10,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:10,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,886 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,895 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,897 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:10,899 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1 2023-02-15 02:01:10,899 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba2c16292696f40ac0d6ee553409024d columnFamilyName f1 2023-02-15 02:01:10,907 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/testWithMapReduce=ba2c16292696f40ac0d6ee553409024d-4545a52981e9466babcc183fb542cda8 2023-02-15 02:01:10,907 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(310): Store=ba2c16292696f40ac0d6ee553409024d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,907 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:10,908 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2 2023-02-15 02:01:10,909 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba2c16292696f40ac0d6ee553409024d columnFamilyName f2 2023-02-15 02:01:10,917 DEBUG [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/testWithMapReduce=ba2c16292696f40ac0d6ee553409024d-783808553fce4ae6906a80f19600064c 2023-02-15 02:01:10,918 INFO [StoreOpener-ba2c16292696f40ac0d6ee553409024d-1] regionserver.HStore(310): Store=ba2c16292696f40ac0d6ee553409024d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,918 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,918 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ba2c16292696f40ac0d6ee553409024d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69688105, jitterRate=0.03843368589878082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,918 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:10,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ba2c16292696f40ac0d6ee553409024d, disabling compactions & flushes 2023-02-15 02:01:10,941 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:10,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:10,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. after waiting 0 ms 2023-02-15 02:01:10,942 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:10,950 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:10,950 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:10,954 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:10,955 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:10,956 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:10,958 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:10,960 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1 2023-02-15 02:01:10,960 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d43d8807bc1c0144bcbf7ce1fa4ef60a columnFamilyName f1 2023-02-15 02:01:10,967 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/testWithMapReduce=d43d8807bc1c0144bcbf7ce1fa4ef60a-7c5297669bf6410281caa150beb1a613 2023-02-15 02:01:10,967 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(310): Store=d43d8807bc1c0144bcbf7ce1fa4ef60a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,967 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:10,968 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2 2023-02-15 02:01:10,969 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d43d8807bc1c0144bcbf7ce1fa4ef60a columnFamilyName f2 2023-02-15 02:01:10,975 DEBUG [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37131/user/jenkins/test-data/0c90a59d-a075-6ad9-9cc8-4a28f3f1ce5a/testWithMapReduceMultiRegion/c062360f-054a-4e69-bd61-118098aaefa4/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/testWithMapReduce=d43d8807bc1c0144bcbf7ce1fa4ef60a-5559867ca2b4465bbbb8e95df46ee941 2023-02-15 02:01:10,976 INFO [StoreOpener-d43d8807bc1c0144bcbf7ce1fa4ef60a-1] regionserver.HStore(310): Store=d43d8807bc1c0144bcbf7ce1fa4ef60a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:10,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:10,976 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d43d8807bc1c0144bcbf7ce1fa4ef60a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61990641, jitterRate=-0.07626746594905853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:10,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:11,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d43d8807bc1c0144bcbf7ce1fa4ef60a, disabling compactions & flushes 2023-02-15 02:01:11,018 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:11,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:11,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. after waiting 0 ms 2023-02-15 02:01:11,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:11,020 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:11,020 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:12,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceMultiRegion" 2023-02-15 02:01:12,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-15 02:01:12,049 INFO [Listener at localhost.localdomain/44729] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 02:01:12,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-15 02:01:12,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426472059"}]},"ts":"1676426472059"} 2023-02-15 02:01:12,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 02:01:12,061 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 02:01:12,063 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 02:01:12,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, UNASSIGN}] 2023-02-15 02:01:12,070 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, UNASSIGN 2023-02-15 02:01:12,070 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, UNASSIGN 2023-02-15 02:01:12,070 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, UNASSIGN 2023-02-15 02:01:12,071 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, UNASSIGN 2023-02-15 02:01:12,071 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, UNASSIGN 2023-02-15 02:01:12,073 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8683f26dde3a7c4fce3afc36e3dd7b00, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,073 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=80e0322f2d623adea82dcbb185d7cb08, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,073 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472072"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472072"}]},"ts":"1676426472072"} 2023-02-15 02:01:12,073 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426472072"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472072"}]},"ts":"1676426472072"} 2023-02-15 02:01:12,073 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=6b9fd63d89233bbf287c4ca3eb70a65a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,073 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=dadf1f57dfe4b02ed1edf951d27e37e4, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,073 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472073"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472073"}]},"ts":"1676426472073"} 2023-02-15 02:01:12,074 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472073"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472073"}]},"ts":"1676426472073"} 2023-02-15 02:01:12,073 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c46656db903b7cf9404e8d31878c69f4, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,074 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426472073"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472073"}]},"ts":"1676426472073"} 2023-02-15 02:01:12,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 8683f26dde3a7c4fce3afc36e3dd7b00, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:12,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 80e0322f2d623adea82dcbb185d7cb08, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:12,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=35, state=RUNNABLE; CloseRegionProcedure 6b9fd63d89233bbf287c4ca3eb70a65a, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:12,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure dadf1f57dfe4b02ed1edf951d27e37e4, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:12,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure c46656db903b7cf9404e8d31878c69f4, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:12,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, UNASSIGN 2023-02-15 02:01:12,093 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, UNASSIGN 2023-02-15 02:01:12,094 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, UNASSIGN 2023-02-15 02:01:12,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8bf5e331546fa7419c02dfbb7aeaf1e3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,095 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, UNASSIGN 2023-02-15 02:01:12,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472094"}]},"ts":"1676426472094"} 2023-02-15 02:01:12,095 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ba2c16292696f40ac0d6ee553409024d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,095 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, UNASSIGN 2023-02-15 02:01:12,095 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472095"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472095"}]},"ts":"1676426472095"} 2023-02-15 02:01:12,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=289e79097eeee10570ba41c9e93aede4, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,096 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8d82f194d69d4ff1d5554e16b717456f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d43d8807bc1c0144bcbf7ce1fa4ef60a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472096"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472096"}]},"ts":"1676426472096"} 2023-02-15 02:01:12,097 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472096"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472096"}]},"ts":"1676426472096"} 2023-02-15 02:01:12,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 8bf5e331546fa7419c02dfbb7aeaf1e3, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:12,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472096"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426472096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426472096"}]},"ts":"1676426472096"} 2023-02-15 02:01:12,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure ba2c16292696f40ac0d6ee553409024d, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:12,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=39, state=RUNNABLE; CloseRegionProcedure 289e79097eeee10570ba41c9e93aede4, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:12,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=40, state=RUNNABLE; CloseRegionProcedure d43d8807bc1c0144bcbf7ce1fa4ef60a, server=jenkins-hbase20.apache.org,44999,1676426459385}] 2023-02-15 02:01:12,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 8d82f194d69d4ff1d5554e16b717456f, server=jenkins-hbase20.apache.org,33675,1676426459341}] 2023-02-15 02:01:12,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 02:01:12,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing dadf1f57dfe4b02ed1edf951d27e37e4, disabling compactions & flushes 2023-02-15 02:01:12,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:12,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:12,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. after waiting 0 ms 2023-02-15 02:01:12,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:12,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:12,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8d82f194d69d4ff1d5554e16b717456f, disabling compactions & flushes 2023-02-15 02:01:12,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:12,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:12,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. after waiting 0 ms 2023-02-15 02:01:12,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:12,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4. 2023-02-15 02:01:12,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for dadf1f57dfe4b02ed1edf951d27e37e4: 2023-02-15 02:01:12,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:12,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:12,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8bf5e331546fa7419c02dfbb7aeaf1e3, disabling compactions & flushes 2023-02-15 02:01:12,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=dadf1f57dfe4b02ed1edf951d27e37e4, regionState=CLOSED 2023-02-15 02:01:12,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:12,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:12,256 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472256"}]},"ts":"1676426472256"} 2023-02-15 02:01:12,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. after waiting 0 ms 2023-02-15 02:01:12,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:12,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-15 02:01:12,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure dadf1f57dfe4b02ed1edf951d27e37e4, server=jenkins-hbase20.apache.org,44999,1676426459385 in 182 msec 2023-02-15 02:01:12,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f. 2023-02-15 02:01:12,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8d82f194d69d4ff1d5554e16b717456f: 2023-02-15 02:01:12,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dadf1f57dfe4b02ed1edf951d27e37e4, UNASSIGN in 199 msec 2023-02-15 02:01:12,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:12,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:12,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8683f26dde3a7c4fce3afc36e3dd7b00, disabling compactions & flushes 2023-02-15 02:01:12,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:12,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:12,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. after waiting 0 ms 2023-02-15 02:01:12,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:12,267 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8d82f194d69d4ff1d5554e16b717456f, regionState=CLOSED 2023-02-15 02:01:12,267 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472267"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472267"}]},"ts":"1676426472267"} 2023-02-15 02:01:12,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3. 2023-02-15 02:01:12,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8bf5e331546fa7419c02dfbb7aeaf1e3: 2023-02-15 02:01:12,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:12,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:12,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 6b9fd63d89233bbf287c4ca3eb70a65a, disabling compactions & flushes 2023-02-15 02:01:12,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:12,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:12,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. after waiting 0 ms 2023-02-15 02:01:12,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:12,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=8bf5e331546fa7419c02dfbb7aeaf1e3, regionState=CLOSED 2023-02-15 02:01:12,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472274"}]},"ts":"1676426472274"} 2023-02-15 02:01:12,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-15 02:01:12,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 8d82f194d69d4ff1d5554e16b717456f, server=jenkins-hbase20.apache.org,33675,1676426459341 in 169 msec 2023-02-15 02:01:12,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8d82f194d69d4ff1d5554e16b717456f, UNASSIGN in 213 msec 2023-02-15 02:01:12,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-15 02:01:12,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 8bf5e331546fa7419c02dfbb7aeaf1e3, server=jenkins-hbase20.apache.org,44999,1676426459385 in 179 msec 2023-02-15 02:01:12,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8bf5e331546fa7419c02dfbb7aeaf1e3, UNASSIGN in 214 msec 2023-02-15 02:01:12,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a. 2023-02-15 02:01:12,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 6b9fd63d89233bbf287c4ca3eb70a65a: 2023-02-15 02:01:12,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00. 2023-02-15 02:01:12,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8683f26dde3a7c4fce3afc36e3dd7b00: 2023-02-15 02:01:12,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:12,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:12,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d43d8807bc1c0144bcbf7ce1fa4ef60a, disabling compactions & flushes 2023-02-15 02:01:12,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:12,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:12,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. after waiting 0 ms 2023-02-15 02:01:12,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:12,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=6b9fd63d89233bbf287c4ca3eb70a65a, regionState=CLOSED 2023-02-15 02:01:12,300 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472299"}]},"ts":"1676426472299"} 2023-02-15 02:01:12,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:12,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:12,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing c46656db903b7cf9404e8d31878c69f4, disabling compactions & flushes 2023-02-15 02:01:12,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:12,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:12,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. after waiting 0 ms 2023-02-15 02:01:12,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:12,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8683f26dde3a7c4fce3afc36e3dd7b00, regionState=CLOSED 2023-02-15 02:01:12,301 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472300"}]},"ts":"1676426472300"} 2023-02-15 02:01:12,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=35 2023-02-15 02:01:12,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=35, state=SUCCESS; CloseRegionProcedure 6b9fd63d89233bbf287c4ca3eb70a65a, server=jenkins-hbase20.apache.org,44999,1676426459385 in 224 msec 2023-02-15 02:01:12,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-15 02:01:12,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6b9fd63d89233bbf287c4ca3eb70a65a, UNASSIGN in 239 msec 2023-02-15 02:01:12,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 02:01:12,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 8683f26dde3a7c4fce3afc36e3dd7b00, server=jenkins-hbase20.apache.org,33675,1676426459341 in 228 msec 2023-02-15 02:01:12,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a. 2023-02-15 02:01:12,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d43d8807bc1c0144bcbf7ce1fa4ef60a: 2023-02-15 02:01:12,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8683f26dde3a7c4fce3afc36e3dd7b00, UNASSIGN in 240 msec 2023-02-15 02:01:12,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4. 2023-02-15 02:01:12,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for c46656db903b7cf9404e8d31878c69f4: 2023-02-15 02:01:12,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:12,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:12,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 289e79097eeee10570ba41c9e93aede4, disabling compactions & flushes 2023-02-15 02:01:12,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:12,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:12,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. after waiting 0 ms 2023-02-15 02:01:12,310 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d43d8807bc1c0144bcbf7ce1fa4ef60a, regionState=CLOSED 2023-02-15 02:01:12,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:12,310 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472310"}]},"ts":"1676426472310"} 2023-02-15 02:01:12,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:12,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:12,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ba2c16292696f40ac0d6ee553409024d, disabling compactions & flushes 2023-02-15 02:01:12,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:12,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:12,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. after waiting 0 ms 2023-02-15 02:01:12,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:12,311 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c46656db903b7cf9404e8d31878c69f4, regionState=CLOSED 2023-02-15 02:01:12,311 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426472311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472311"}]},"ts":"1676426472311"} 2023-02-15 02:01:12,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4. 2023-02-15 02:01:12,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 289e79097eeee10570ba41c9e93aede4: 2023-02-15 02:01:12,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=40 2023-02-15 02:01:12,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=40, state=SUCCESS; CloseRegionProcedure d43d8807bc1c0144bcbf7ce1fa4ef60a, server=jenkins-hbase20.apache.org,44999,1676426459385 in 211 msec 2023-02-15 02:01:12,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-15 02:01:12,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure c46656db903b7cf9404e8d31878c69f4, server=jenkins-hbase20.apache.org,33675,1676426459341 in 234 msec 2023-02-15 02:01:12,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:12,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d43d8807bc1c0144bcbf7ce1fa4ef60a, UNASSIGN in 255 msec 2023-02-15 02:01:12,322 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=289e79097eeee10570ba41c9e93aede4, regionState=CLOSED 2023-02-15 02:01:12,322 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472322"}]},"ts":"1676426472322"} 2023-02-15 02:01:12,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:12,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d. 2023-02-15 02:01:12,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ba2c16292696f40ac0d6ee553409024d: 2023-02-15 02:01:12,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c46656db903b7cf9404e8d31878c69f4, UNASSIGN in 256 msec 2023-02-15 02:01:12,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:12,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:12,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 80e0322f2d623adea82dcbb185d7cb08, disabling compactions & flushes 2023-02-15 02:01:12,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:12,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:12,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. after waiting 0 ms 2023-02-15 02:01:12,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:12,327 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ba2c16292696f40ac0d6ee553409024d, regionState=CLOSED 2023-02-15 02:01:12,327 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426472327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472327"}]},"ts":"1676426472327"} 2023-02-15 02:01:12,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=39 2023-02-15 02:01:12,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=39, state=SUCCESS; CloseRegionProcedure 289e79097eeee10570ba41c9e93aede4, server=jenkins-hbase20.apache.org,44999,1676426459385 in 225 msec 2023-02-15 02:01:12,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=289e79097eeee10570ba41c9e93aede4, UNASSIGN in 263 msec 2023-02-15 02:01:12,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-15 02:01:12,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure ba2c16292696f40ac0d6ee553409024d, server=jenkins-hbase20.apache.org,33675,1676426459341 in 230 msec 2023-02-15 02:01:12,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ba2c16292696f40ac0d6ee553409024d, UNASSIGN in 266 msec 2023-02-15 02:01:12,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 02:01:12,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08. 2023-02-15 02:01:12,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 80e0322f2d623adea82dcbb185d7cb08: 2023-02-15 02:01:12,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:12,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=80e0322f2d623adea82dcbb185d7cb08, regionState=CLOSED 2023-02-15 02:01:12,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426472340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426472340"}]},"ts":"1676426472340"} 2023-02-15 02:01:12,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-15 02:01:12,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 80e0322f2d623adea82dcbb185d7cb08, server=jenkins-hbase20.apache.org,33675,1676426459341 in 266 msec 2023-02-15 02:01:12,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-15 02:01:12,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=80e0322f2d623adea82dcbb185d7cb08, UNASSIGN in 277 msec 2023-02-15 02:01:12,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426472346"}]},"ts":"1676426472346"} 2023-02-15 02:01:12,348 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 02:01:12,350 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 02:01:12,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 300 msec 2023-02-15 02:01:12,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 02:01:12,365 INFO [Listener at localhost.localdomain/44729] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-15 02:01:12,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-15 02:01:12,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,382 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:12,402 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/recovered.edits] 2023-02-15 02:01:12,410 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/recovered.edits] 2023-02-15 02:01:12,423 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/6f3c6795f61d4f64a42c8286841844f8 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/6f3c6795f61d4f64a42c8286841844f8 2023-02-15 02:01:12,424 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/39a895f331444ee987b93510ed7b165b to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/39a895f331444ee987b93510ed7b165b 2023-02-15 02:01:12,425 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/5f74277b74dc4c11b7cafffef2f5bee5 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/5f74277b74dc4c11b7cafffef2f5bee5 2023-02-15 02:01:12,425 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/2fac720e5440405c978d3f9dae82b9e3 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/2fac720e5440405c978d3f9dae82b9e3 2023-02-15 02:01:12,426 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/1310f306f8b94162b7ef535022d244ba to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/1310f306f8b94162b7ef535022d244ba 2023-02-15 02:01:12,426 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/55e5bdecf5b246c8abd5c339b7cb4bde to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/55e5bdecf5b246c8abd5c339b7cb4bde 2023-02-15 02:01:12,427 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/dd853fda7f2c4cae9685c669587ab504 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/dd853fda7f2c4cae9685c669587ab504 2023-02-15 02:01:12,427 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/7c5297669bf6410281caa150beb1a613 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f1/7c5297669bf6410281caa150beb1a613 2023-02-15 02:01:12,428 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/4545a52981e9466babcc183fb542cda8 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f1/4545a52981e9466babcc183fb542cda8 2023-02-15 02:01:12,428 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/bf68242c7c8649d5ad51a9694644ed52 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f1/bf68242c7c8649d5ad51a9694644ed52 2023-02-15 02:01:12,429 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/96dda6f69c7d4ac6969ef81e3062ec5e to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f1/96dda6f69c7d4ac6969ef81e3062ec5e 2023-02-15 02:01:12,429 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/c3bc6131362a48158f93918dd5ba494e to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f1/c3bc6131362a48158f93918dd5ba494e 2023-02-15 02:01:12,430 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/d0b04c4625ff4f1a8032af5be1472d26 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f1/d0b04c4625ff4f1a8032af5be1472d26 2023-02-15 02:01:12,431 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/f5d1cfdb911c41cd98d038d0208a2467 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f1/f5d1cfdb911c41cd98d038d0208a2467 2023-02-15 02:01:12,434 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/recovered.edits/6.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4/recovered.edits/6.seqid 2023-02-15 02:01:12,435 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/c46656db903b7cf9404e8d31878c69f4 2023-02-15 02:01:12,435 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:12,438 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/17b9ab8efdb046c395334323976568c2 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/17b9ab8efdb046c395334323976568c2 2023-02-15 02:01:12,438 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/4637a1b243034bfa8e29f210ecb5b572 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/4637a1b243034bfa8e29f210ecb5b572 2023-02-15 02:01:12,439 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/99452c04f4fd48e291adc83cabf9263c to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/99452c04f4fd48e291adc83cabf9263c 2023-02-15 02:01:12,439 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/783808553fce4ae6906a80f19600064c to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/783808553fce4ae6906a80f19600064c 2023-02-15 02:01:12,440 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/377716ce890d40c4957f797d937369c8 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/377716ce890d40c4957f797d937369c8 2023-02-15 02:01:12,441 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/0251d90b94c34591bf3a1f953982cf90 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/0251d90b94c34591bf3a1f953982cf90 2023-02-15 02:01:12,442 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/recovered.edits] 2023-02-15 02:01:12,443 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5559867ca2b4465bbbb8e95df46ee941 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5559867ca2b4465bbbb8e95df46ee941 2023-02-15 02:01:12,443 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/c7df3d1e74c540c79a2ac1feb3f3f3af to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/f2/c7df3d1e74c540c79a2ac1feb3f3f3af 2023-02-15 02:01:12,445 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/bcc056de454147ad969b479972cfb9ba to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/f2/bcc056de454147ad969b479972cfb9ba 2023-02-15 02:01:12,446 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/bd4d392d654f41a389a26e337781a27c to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/f2/bd4d392d654f41a389a26e337781a27c 2023-02-15 02:01:12,446 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/4c39582049ae40a99a5803ca3bcbb119 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/f2/4c39582049ae40a99a5803ca3bcbb119 2023-02-15 02:01:12,446 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/bf848a47affe47ad86311716be53b473 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/f2/bf848a47affe47ad86311716be53b473 2023-02-15 02:01:12,446 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/2cf26a3993a0459a8e1133348ae395da to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/f2/2cf26a3993a0459a8e1133348ae395da 2023-02-15 02:01:12,447 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5db5a3b7a73b4038894a85b4e3ee4e5a to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/f2/5db5a3b7a73b4038894a85b4e3ee4e5a 2023-02-15 02:01:12,451 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4/recovered.edits/12.seqid 2023-02-15 02:01:12,454 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/dadf1f57dfe4b02ed1edf951d27e37e4 2023-02-15 02:01:12,454 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:12,455 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4/recovered.edits/12.seqid 2023-02-15 02:01:12,455 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f/recovered.edits/12.seqid 2023-02-15 02:01:12,455 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d/recovered.edits/12.seqid 2023-02-15 02:01:12,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00/recovered.edits/12.seqid 2023-02-15 02:01:12,456 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/8099acbb499444e485172ff9c52de211 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/8099acbb499444e485172ff9c52de211 2023-02-15 02:01:12,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/289e79097eeee10570ba41c9e93aede4 2023-02-15 02:01:12,456 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8d82f194d69d4ff1d5554e16b717456f 2023-02-15 02:01:12,457 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a/recovered.edits/12.seqid 2023-02-15 02:01:12,457 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/ba2c16292696f40ac0d6ee553409024d 2023-02-15 02:01:12,457 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8683f26dde3a7c4fce3afc36e3dd7b00 2023-02-15 02:01:12,457 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a/recovered.edits/12.seqid 2023-02-15 02:01:12,458 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/6b9fd63d89233bbf287c4ca3eb70a65a 2023-02-15 02:01:12,458 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/d43d8807bc1c0144bcbf7ce1fa4ef60a 2023-02-15 02:01:12,459 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f1, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/f2, FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/recovered.edits] 2023-02-15 02:01:12,459 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/c4d5accdadab4b95b561171780b4de34 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f1/c4d5accdadab4b95b561171780b4de34 2023-02-15 02:01:12,463 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/38d7358348b74aa488501dc2675eccad to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/38d7358348b74aa488501dc2675eccad 2023-02-15 02:01:12,465 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/5b195e9942f44596965275c165b059e1 to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/f2/5b195e9942f44596965275c165b059e1 2023-02-15 02:01:12,466 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/recovered.edits/6.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08/recovered.edits/6.seqid 2023-02-15 02:01:12,467 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/80e0322f2d623adea82dcbb185d7cb08 2023-02-15 02:01:12,474 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/recovered.edits/12.seqid to hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/archive/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3/recovered.edits/12.seqid 2023-02-15 02:01:12,475 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/.tmp/data/default/testWithMapReduce/8bf5e331546fa7419c02dfbb7aeaf1e3 2023-02-15 02:01:12,475 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 02:01:12,478 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 02:01:12,512 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-15 02:01:12,516 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 02:01:12,517 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,517 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426472517"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,521 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 02:01:12,521 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c46656db903b7cf9404e8d31878c69f4, NAME => 'testWithMapReduce,,1676426463154.c46656db903b7cf9404e8d31878c69f4.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 6b9fd63d89233bbf287c4ca3eb70a65a, NAME => 'testWithMapReduce,aaa,1676426463154.6b9fd63d89233bbf287c4ca3eb70a65a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 8683f26dde3a7c4fce3afc36e3dd7b00, NAME => 'testWithMapReduce,d\x84\x84,1676426463154.8683f26dde3a7c4fce3afc36e3dd7b00.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => dadf1f57dfe4b02ed1edf951d27e37e4, NAME => 'testWithMapReduce,g\xA7\xA7,1676426463154.dadf1f57dfe4b02ed1edf951d27e37e4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 8d82f194d69d4ff1d5554e16b717456f, NAME => 'testWithMapReduce,j\xCA\xCA,1676426463154.8d82f194d69d4ff1d5554e16b717456f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 289e79097eeee10570ba41c9e93aede4, NAME => 'testWithMapReduce,m\xED\xED,1676426463154.289e79097eeee10570ba41c9e93aede4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => d43d8807bc1c0144bcbf7ce1fa4ef60a, NAME => 'testWithMapReduce,q\x11\x10,1676426463154.d43d8807bc1c0144bcbf7ce1fa4ef60a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => ba2c16292696f40ac0d6ee553409024d, NAME => 'testWithMapReduce,t43,1676426463154.ba2c16292696f40ac0d6ee553409024d.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 8bf5e331546fa7419c02dfbb7aeaf1e3, NAME => 'testWithMapReduce,wWV,1676426463154.8bf5e331546fa7419c02dfbb7aeaf1e3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 80e0322f2d623adea82dcbb185d7cb08, NAME => 'testWithMapReduce,zz{,1676426463154.80e0322f2d623adea82dcbb185d7cb08.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 02:01:12,522 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 02:01:12,522 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676426472522"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:12,524 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 02:01:12,526 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:12,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 154 msec 2023-02-15 02:01:12,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45815] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 02:01:12,690 INFO [Listener at localhost.localdomain/44729] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-15 02:01:12,690 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:12,690 INFO [Listener at localhost.localdomain/44729] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:12,690 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a6375fb to 127.0.0.1:50976 2023-02-15 02:01:12,690 DEBUG [Listener at localhost.localdomain/44729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,690 DEBUG [Listener at localhost.localdomain/44729] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:12,690 DEBUG [Listener at localhost.localdomain/44729] util.JVMClusterUtil(257): Found active master hash=599533390, stopped=false 2023-02-15 02:01:12,690 INFO [Listener at localhost.localdomain/44729] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:01:12,693 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:12,693 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:12,693 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:12,693 INFO [Listener at localhost.localdomain/44729] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:12,693 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:12,694 DEBUG [Listener at localhost.localdomain/44729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00b4ce18 to 127.0.0.1:50976 2023-02-15 02:01:12,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:12,694 DEBUG [Listener at localhost.localdomain/44729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:12,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:12,694 INFO [Listener at localhost.localdomain/44729] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33675,1676426459341' ***** 2023-02-15 02:01:12,695 INFO [Listener at localhost.localdomain/44729] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:12,695 INFO [Listener at localhost.localdomain/44729] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44999,1676426459385' ***** 2023-02-15 02:01:12,695 INFO [Listener at localhost.localdomain/44729] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:12,695 INFO [RS:0;jenkins-hbase20:33675] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:12,696 INFO [RS:0;jenkins-hbase20:33675] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:12,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:12,696 INFO [RS:0;jenkins-hbase20:33675] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:12,695 INFO [RS:1;jenkins-hbase20:44999] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:12,696 INFO [RS:1;jenkins-hbase20:44999] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:12,696 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(3304): Received CLOSE for fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:12,696 INFO [RS:1;jenkins-hbase20:44999] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:12,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:12,696 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,697 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,697 DEBUG [RS:1;jenkins-hbase20:44999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x574f2949 to 127.0.0.1:50976 2023-02-15 02:01:12,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing fc8be43497612e90df605dc7710143c4, disabling compactions & flushes 2023-02-15 02:01:12,697 DEBUG [RS:0;jenkins-hbase20:33675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73c06bff to 127.0.0.1:50976 2023-02-15 02:01:12,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:12,698 DEBUG [RS:1;jenkins-hbase20:44999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:12,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. after waiting 0 ms 2023-02-15 02:01:12,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:12,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing fc8be43497612e90df605dc7710143c4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:12,698 DEBUG [RS:0;jenkins-hbase20:33675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,698 INFO [RS:1;jenkins-hbase20:44999] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:12,698 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 02:01:12,698 INFO [RS:1;jenkins-hbase20:44999] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:12,698 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1479): Online Regions={fc8be43497612e90df605dc7710143c4=hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4.} 2023-02-15 02:01:12,700 DEBUG [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1505): Waiting on fc8be43497612e90df605dc7710143c4 2023-02-15 02:01:12,698 INFO [RS:1;jenkins-hbase20:44999] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:12,700 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:12,700 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 02:01:12,700 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 02:01:12,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:12,701 DEBUG [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 02:01:12,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:12,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:12,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:12,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:12,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.32 KB heapSize=40.20 KB 2023-02-15 02:01:12,706 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:12,706 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:12,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/.tmp/info/323a86f91e99401aabb9322ec7432a57 2023-02-15 02:01:12,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.11 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/.tmp/info/769fc6d1285d42d6ac87a586618e4f4b 2023-02-15 02:01:12,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/.tmp/info/323a86f91e99401aabb9322ec7432a57 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/info/323a86f91e99401aabb9322ec7432a57 2023-02-15 02:01:12,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 769fc6d1285d42d6ac87a586618e4f4b 2023-02-15 02:01:12,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/info/323a86f91e99401aabb9322ec7432a57, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:12,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fc8be43497612e90df605dc7710143c4 in 29ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:12,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/namespace/fc8be43497612e90df605dc7710143c4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:12,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:12,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for fc8be43497612e90df605dc7710143c4: 2023-02-15 02:01:12,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426462283.fc8be43497612e90df605dc7710143c4. 2023-02-15 02:01:12,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/.tmp/rep_barrier/fbf57272cecd402fa16fe0c42660a2ae 2023-02-15 02:01:12,753 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 02:01:12,753 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 02:01:12,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf57272cecd402fa16fe0c42660a2ae 2023-02-15 02:01:12,773 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/.tmp/table/f24343d952814a2ebd1237bb82bb45a3 2023-02-15 02:01:12,781 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24343d952814a2ebd1237bb82bb45a3 2023-02-15 02:01:12,782 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/.tmp/info/769fc6d1285d42d6ac87a586618e4f4b as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/info/769fc6d1285d42d6ac87a586618e4f4b 2023-02-15 02:01:12,788 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 769fc6d1285d42d6ac87a586618e4f4b 2023-02-15 02:01:12,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/info/769fc6d1285d42d6ac87a586618e4f4b, entries=30, sequenceid=57, filesize=7.9 K 2023-02-15 02:01:12,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/.tmp/rep_barrier/fbf57272cecd402fa16fe0c42660a2ae as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/rep_barrier/fbf57272cecd402fa16fe0c42660a2ae 2023-02-15 02:01:12,799 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf57272cecd402fa16fe0c42660a2ae 2023-02-15 02:01:12,799 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/rep_barrier/fbf57272cecd402fa16fe0c42660a2ae, entries=10, sequenceid=57, filesize=5.9 K 2023-02-15 02:01:12,801 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/.tmp/table/f24343d952814a2ebd1237bb82bb45a3 as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/table/f24343d952814a2ebd1237bb82bb45a3 2023-02-15 02:01:12,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24343d952814a2ebd1237bb82bb45a3 2023-02-15 02:01:12,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/table/f24343d952814a2ebd1237bb82bb45a3, entries=13, sequenceid=57, filesize=5.9 K 2023-02-15 02:01:12,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.32 KB/24908, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 111ms, sequenceid=57, compaction requested=false 2023-02-15 02:01:12,827 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 02:01:12,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:12,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:12,829 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:12,829 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:12,900 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33675,1676426459341; all regions closed. 2023-02-15 02:01:12,901 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44999,1676426459385; all regions closed. 2023-02-15 02:01:12,911 DEBUG [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/oldWALs 2023-02-15 02:01:12,911 INFO [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44999%2C1676426459385.meta:.meta(num 1676426461979) 2023-02-15 02:01:12,912 DEBUG [RS:0;jenkins-hbase20:33675] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/oldWALs 2023-02-15 02:01:12,912 INFO [RS:0;jenkins-hbase20:33675] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33675%2C1676426459341:(num 1676426462724) 2023-02-15 02:01:12,912 DEBUG [RS:0;jenkins-hbase20:33675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,912 INFO [RS:0;jenkins-hbase20:33675] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:12,912 INFO [RS:0;jenkins-hbase20:33675] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:12,914 INFO [RS:0;jenkins-hbase20:33675] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:12,914 INFO [RS:0;jenkins-hbase20:33675] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:12,914 INFO [RS:0;jenkins-hbase20:33675] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:12,914 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:12,915 INFO [RS:0;jenkins-hbase20:33675] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33675 2023-02-15 02:01:12,918 DEBUG [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/oldWALs 2023-02-15 02:01:12,918 INFO [RS:1;jenkins-hbase20:44999] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44999%2C1676426459385:(num 1676426462726) 2023-02-15 02:01:12,918 DEBUG [RS:1;jenkins-hbase20:44999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,918 INFO [RS:1;jenkins-hbase20:44999] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:12,918 INFO [RS:1;jenkins-hbase20:44999] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:12,919 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:12,920 INFO [RS:1;jenkins-hbase20:44999] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44999 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44999,1676426459385 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,923 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33675,1676426459341 2023-02-15 02:01:12,924 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33675,1676426459341] 2023-02-15 02:01:12,924 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33675,1676426459341; numProcessing=1 2023-02-15 02:01:12,925 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33675,1676426459341 already deleted, retry=false 2023-02-15 02:01:12,925 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33675,1676426459341 expired; onlineServers=1 2023-02-15 02:01:12,925 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44999,1676426459385] 2023-02-15 02:01:12,925 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44999,1676426459385; numProcessing=2 2023-02-15 02:01:12,925 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44999,1676426459385 already deleted, retry=false 2023-02-15 02:01:12,925 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44999,1676426459385 expired; onlineServers=0 2023-02-15 02:01:12,925 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,45815,1676426458286' ***** 2023-02-15 02:01:12,925 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:12,926 DEBUG [M:0;jenkins-hbase20:45815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62812d75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:12,926 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,45815,1676426458286 2023-02-15 02:01:12,926 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,45815,1676426458286; all regions closed. 2023-02-15 02:01:12,926 DEBUG [M:0;jenkins-hbase20:45815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:12,926 DEBUG [M:0;jenkins-hbase20:45815] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:12,926 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:12,926 DEBUG [M:0;jenkins-hbase20:45815] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:12,926 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426460488] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426460488,5,FailOnTimeoutGroup] 2023-02-15 02:01:12,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426460488] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426460488,5,FailOnTimeoutGroup] 2023-02-15 02:01:12,928 INFO [M:0;jenkins-hbase20:45815] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:12,928 INFO [M:0;jenkins-hbase20:45815] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:12,928 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:12,928 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:12,928 INFO [M:0;jenkins-hbase20:45815] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:12,929 DEBUG [M:0;jenkins-hbase20:45815] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:12,929 INFO [M:0;jenkins-hbase20:45815] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:12,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:12,929 ERROR [M:0;jenkins-hbase20:45815] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-15 02:01:12,930 INFO [M:0;jenkins-hbase20:45815] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:12,930 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:12,930 DEBUG [M:0;jenkins-hbase20:45815] zookeeper.ZKUtil(398): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 02:01:12,930 WARN [M:0;jenkins-hbase20:45815] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 02:01:12,930 INFO [M:0;jenkins-hbase20:45815] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:12,931 INFO [M:0;jenkins-hbase20:45815] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:12,931 DEBUG [M:0;jenkins-hbase20:45815] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:12,931 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:12,931 DEBUG [M:0;jenkins-hbase20:45815] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:12,931 DEBUG [M:0;jenkins-hbase20:45815] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:12,931 DEBUG [M:0;jenkins-hbase20:45815] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:12,931 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.48 KB heapSize=192.44 KB 2023-02-15 02:01:12,966 INFO [M:0;jenkins-hbase20:45815] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.48 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4f4f423dcd80443e95f32696fcf7f90e 2023-02-15 02:01:12,971 DEBUG [M:0;jenkins-hbase20:45815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4f4f423dcd80443e95f32696fcf7f90e as hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4f4f423dcd80443e95f32696fcf7f90e 2023-02-15 02:01:12,977 INFO [M:0;jenkins-hbase20:45815] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37131/user/jenkins/test-data/c0505572-db5e-f829-72df-803057092647/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4f4f423dcd80443e95f32696fcf7f90e, entries=53, sequenceid=357, filesize=10.4 K 2023-02-15 02:01:12,978 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegion(2947): Finished flush of dataSize ~159.48 KB/163309, heapSize ~192.42 KB/197040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 47ms, sequenceid=357, compaction requested=false 2023-02-15 02:01:12,980 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:12,980 DEBUG [M:0;jenkins-hbase20:45815] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:12,984 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:12,984 INFO [M:0;jenkins-hbase20:45815] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:12,984 INFO [M:0;jenkins-hbase20:45815] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45815 2023-02-15 02:01:12,992 DEBUG [M:0;jenkins-hbase20:45815] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,45815,1676426458286 already deleted, retry=false 2023-02-15 02:01:13,024 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:13,024 INFO [RS:1;jenkins-hbase20:44999] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44999,1676426459385; zookeeper connection closed. 2023-02-15 02:01:13,025 ERROR [Listener at localhost.localdomain/44729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@599913e3 rejected from java.util.concurrent.ThreadPoolExecutor@5da68c08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:13,025 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@490aa930] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@490aa930 2023-02-15 02:01:13,025 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:44999-0x10163dd73050002, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:13,025 ERROR [Listener at localhost.localdomain/44729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38614893 rejected from java.util.concurrent.ThreadPoolExecutor@5da68c08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:13,125 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:13,125 INFO [M:0;jenkins-hbase20:45815] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,45815,1676426458286; zookeeper connection closed. 2023-02-15 02:01:13,125 ERROR [Listener at localhost.localdomain/44729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f5d1f09 rejected from java.util.concurrent.ThreadPoolExecutor@2bc5b4b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:13,125 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): master:45815-0x10163dd73050000, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:13,125 ERROR [Listener at localhost.localdomain/44729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71450171 rejected from java.util.concurrent.ThreadPoolExecutor@2bc5b4b8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:13,225 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:13,225 INFO [RS:0;jenkins-hbase20:33675] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33675,1676426459341; zookeeper connection closed. 2023-02-15 02:01:13,225 ERROR [Listener at localhost.localdomain/44729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a29cd0d rejected from java.util.concurrent.ThreadPoolExecutor@e164890[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:13,225 DEBUG [Listener at localhost.localdomain/44729-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x10163dd73050001, quorum=127.0.0.1:50976, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:13,225 ERROR [Listener at localhost.localdomain/44729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e101c97 rejected from java.util.concurrent.ThreadPoolExecutor@e164890[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:13,226 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40e199bc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40e199bc 2023-02-15 02:01:13,226 INFO [Listener at localhost.localdomain/44729] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:13,226 WARN [Listener at localhost.localdomain/44729] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:13,230 INFO [Listener at localhost.localdomain/44729] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:13,233 WARN [BP-1021049147-148.251.75.209-1676426454892 heartbeating to localhost.localdomain/127.0.0.1:37131] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:13,233 WARN [BP-1021049147-148.251.75.209-1676426454892 heartbeating to localhost.localdomain/127.0.0.1:37131] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1021049147-148.251.75.209-1676426454892 (Datanode Uuid d52bd59f-570e-4c75-a412-9fe8c0b8504f) service to localhost.localdomain/127.0.0.1:37131 2023-02-15 02:01:13,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/dfs/data/data3/current/BP-1021049147-148.251.75.209-1676426454892] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:13,235 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/dfs/data/data4/current/BP-1021049147-148.251.75.209-1676426454892] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:13,236 WARN [Listener at localhost.localdomain/44729] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:13,240 INFO [Listener at localhost.localdomain/44729] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:13,342 WARN [BP-1021049147-148.251.75.209-1676426454892 heartbeating to localhost.localdomain/127.0.0.1:37131] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:13,343 WARN [BP-1021049147-148.251.75.209-1676426454892 heartbeating to localhost.localdomain/127.0.0.1:37131] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1021049147-148.251.75.209-1676426454892 (Datanode Uuid 8c9bd998-0665-41dc-be40-4ea03e198511) service to localhost.localdomain/127.0.0.1:37131 2023-02-15 02:01:13,343 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/dfs/data/data1/current/BP-1021049147-148.251.75.209-1676426454892] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:13,344 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/cluster_3c90c03a-1e37-e76c-fc1d-37853b61c0f7/dfs/data/data2/current/BP-1021049147-148.251.75.209-1676426454892] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:13,380 INFO [Listener at localhost.localdomain/44729] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:13,504 INFO [Listener at localhost.localdomain/44729] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:13,575 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:13,587 INFO [Listener at localhost.localdomain/44729] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=102 (was 7) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost.localdomain/44729 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:37131 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,45815,1676426458286)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37131 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37131 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:37131 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37131 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1ffa4774 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:37131 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37131 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=538 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=349 (was 173) - SystemLoadAverage LEAK? -, ProcessCount=163 (was 163), AvailableMemoryMB=6010 (was 7015) 2023-02-15 02:01:13,595 INFO [Listener at localhost.localdomain/44729] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=102, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=349, ProcessCount=163, AvailableMemoryMB=6010 2023-02-15 02:01:13,603 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop.log.dir so I do NOT create it in target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b 2023-02-15 02:01:13,603 WARN [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 02:01:13,603 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop.tmp.dir so I do NOT create it in target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b 2023-02-15 02:01:13,604 WARN [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/43f5ebfe-9dba-18b3-6115-155543937043/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 02:01:13,604 DEBUG [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5, deleteOnExit=true 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/test.cache.data in system properties and HBase conf 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:01:13,604 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:01:13,605 DEBUG [Listener at localhost.localdomain/44729] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:13,605 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:13,606 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:01:13,606 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:01:13,606 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:01:13,606 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:13,606 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:01:13,606 INFO [Listener at localhost.localdomain/44729] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:01:13,609 WARN [Listener at localhost.localdomain/44729] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:13,609 WARN [Listener at localhost.localdomain/44729] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:13,638 WARN [Listener at localhost.localdomain/44729] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:13,640 INFO [Listener at localhost.localdomain/44729] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:13,648 INFO [Listener at localhost.localdomain/44729] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/java.io.tmpdir/Jetty_localhost_localdomain_43137_hdfs____gxvl8w/webapp 2023-02-15 02:01:13,735 INFO [Listener at localhost.localdomain/44729] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:43137 2023-02-15 02:01:13,737 WARN [Listener at localhost.localdomain/44729] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:13,738 WARN [Listener at localhost.localdomain/44729] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:13,770 WARN [Listener at localhost.localdomain/36269] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:13,788 WARN [Listener at localhost.localdomain/36269] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:13,790 WARN [Listener at localhost.localdomain/36269] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:13,791 INFO [Listener at localhost.localdomain/36269] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:13,796 INFO [Listener at localhost.localdomain/36269] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/java.io.tmpdir/Jetty_localhost_34635_datanode____.dspqwy/webapp 2023-02-15 02:01:13,867 INFO [Listener at localhost.localdomain/36269] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34635 2023-02-15 02:01:13,874 WARN [Listener at localhost.localdomain/41451] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:13,894 WARN [Listener at localhost.localdomain/41451] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:13,896 WARN [Listener at localhost.localdomain/41451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:13,897 INFO [Listener at localhost.localdomain/41451] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:13,901 INFO [Listener at localhost.localdomain/41451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/java.io.tmpdir/Jetty_localhost_33055_datanode____.tlv9ux/webapp 2023-02-15 02:01:13,950 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f75f4c66b803f66: Processing first storage report for DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1 from datanode 06a7d9c6-7649-4193-a0f3-782c1af57959 2023-02-15 02:01:13,950 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f75f4c66b803f66: from storage DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1 node DatanodeRegistration(127.0.0.1:35491, datanodeUuid=06a7d9c6-7649-4193-a0f3-782c1af57959, infoPort=34293, infoSecurePort=0, ipcPort=41451, storageInfo=lv=-57;cid=testClusterID;nsid=2083544897;c=1676426473611), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:13,951 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f75f4c66b803f66: Processing first storage report for DS-c7922a1f-9a4c-419c-8622-d15fac223f61 from datanode 06a7d9c6-7649-4193-a0f3-782c1af57959 2023-02-15 02:01:13,951 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f75f4c66b803f66: from storage DS-c7922a1f-9a4c-419c-8622-d15fac223f61 node DatanodeRegistration(127.0.0.1:35491, datanodeUuid=06a7d9c6-7649-4193-a0f3-782c1af57959, infoPort=34293, infoSecurePort=0, ipcPort=41451, storageInfo=lv=-57;cid=testClusterID;nsid=2083544897;c=1676426473611), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:14,005 INFO [Listener at localhost.localdomain/41451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33055 2023-02-15 02:01:14,015 WARN [Listener at localhost.localdomain/34749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:14,097 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x94019bac2612c7d7: Processing first storage report for DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1 from datanode ce09bf3c-1d08-4cf3-8486-dbbb1931fd6c 2023-02-15 02:01:14,097 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x94019bac2612c7d7: from storage DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1 node DatanodeRegistration(127.0.0.1:36955, datanodeUuid=ce09bf3c-1d08-4cf3-8486-dbbb1931fd6c, infoPort=46339, infoSecurePort=0, ipcPort=34749, storageInfo=lv=-57;cid=testClusterID;nsid=2083544897;c=1676426473611), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:14,098 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x94019bac2612c7d7: Processing first storage report for DS-bdc286db-203f-459e-bac4-2d5fd57e74d3 from datanode ce09bf3c-1d08-4cf3-8486-dbbb1931fd6c 2023-02-15 02:01:14,098 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x94019bac2612c7d7: from storage DS-bdc286db-203f-459e-bac4-2d5fd57e74d3 node DatanodeRegistration(127.0.0.1:36955, datanodeUuid=ce09bf3c-1d08-4cf3-8486-dbbb1931fd6c, infoPort=46339, infoSecurePort=0, ipcPort=34749, storageInfo=lv=-57;cid=testClusterID;nsid=2083544897;c=1676426473611), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:14,131 DEBUG [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b 2023-02-15 02:01:14,133 INFO [Listener at localhost.localdomain/34749] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/zookeeper_0, clientPort=61388, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:01:14,135 INFO [Listener at localhost.localdomain/34749] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61388 2023-02-15 02:01:14,135 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,136 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,153 INFO [Listener at localhost.localdomain/34749] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777 with version=8 2023-02-15 02:01:14,153 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,154 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,156 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/hbase-staging 2023-02-15 02:01:14,158 INFO [Listener at localhost.localdomain/34749] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:14,158 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,159 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,159 INFO [Listener at localhost.localdomain/34749] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:14,159 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,159 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:14,159 INFO [Listener at localhost.localdomain/34749] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:14,161 INFO [Listener at localhost.localdomain/34749] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33825 2023-02-15 02:01:14,162 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,163 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,164 INFO [Listener at localhost.localdomain/34749] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33825 connecting to ZooKeeper ensemble=127.0.0.1:61388 2023-02-15 02:01:14,179 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:338250x0, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:14,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33825-0x10163ddb4440000 connected 2023-02-15 02:01:14,207 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:14,208 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:14,208 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:14,212 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33825 2023-02-15 02:01:14,212 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33825 2023-02-15 02:01:14,212 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33825 2023-02-15 02:01:14,213 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33825 2023-02-15 02:01:14,213 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33825 2023-02-15 02:01:14,213 INFO [Listener at localhost.localdomain/34749] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777, hbase.cluster.distributed=false 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:14,227 INFO [Listener at localhost.localdomain/34749] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:14,231 INFO [Listener at localhost.localdomain/34749] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33779 2023-02-15 02:01:14,231 INFO [Listener at localhost.localdomain/34749] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:14,235 DEBUG [Listener at localhost.localdomain/34749] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:14,236 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,238 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,239 INFO [Listener at localhost.localdomain/34749] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33779 connecting to ZooKeeper ensemble=127.0.0.1:61388 2023-02-15 02:01:14,242 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:337790x0, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:14,243 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): regionserver:337790x0, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:14,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33779-0x10163ddb4440001 connected 2023-02-15 02:01:14,244 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:14,245 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:14,246 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33779 2023-02-15 02:01:14,246 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33779 2023-02-15 02:01:14,251 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33779 2023-02-15 02:01:14,251 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33779 2023-02-15 02:01:14,255 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33779 2023-02-15 02:01:14,267 INFO [Listener at localhost.localdomain/34749] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:14,267 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,267 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,267 INFO [Listener at localhost.localdomain/34749] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:14,267 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:14,267 INFO [Listener at localhost.localdomain/34749] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:14,268 INFO [Listener at localhost.localdomain/34749] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:14,269 INFO [Listener at localhost.localdomain/34749] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34777 2023-02-15 02:01:14,270 INFO [Listener at localhost.localdomain/34749] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:14,271 DEBUG [Listener at localhost.localdomain/34749] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:14,271 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,272 INFO [Listener at localhost.localdomain/34749] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,273 INFO [Listener at localhost.localdomain/34749] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34777 connecting to ZooKeeper ensemble=127.0.0.1:61388 2023-02-15 02:01:14,276 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:347770x0, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:14,277 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): regionserver:347770x0, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:14,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34777-0x10163ddb4440002 connected 2023-02-15 02:01:14,278 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:14,279 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:14,283 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34777 2023-02-15 02:01:14,283 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34777 2023-02-15 02:01:14,283 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34777 2023-02-15 02:01:14,287 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34777 2023-02-15 02:01:14,287 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34777 2023-02-15 02:01:14,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,291 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:14,292 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,293 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:14,293 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:14,293 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:14,293 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:14,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,33825,1676426474158 from backup master directory 2023-02-15 02:01:14,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:14,296 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,296 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:14,296 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:14,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,319 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/hbase.id with ID: 6aa3f551-d985-4002-b937-055215c7662f 2023-02-15 02:01:14,330 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:14,333 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,345 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x04c4580b to 127.0.0.1:61388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:14,349 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ac06daf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:14,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:14,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:01:14,351 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:14,352 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store-tmp 2023-02-15 02:01:14,361 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:14,361 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:14,361 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:14,361 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:14,361 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:14,361 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:14,361 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:14,361 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:14,362 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/WALs/jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,364 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33825%2C1676426474158, suffix=, logDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/WALs/jenkins-hbase20.apache.org,33825,1676426474158, archiveDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/oldWALs, maxLogs=10 2023-02-15 02:01:14,404 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK] 2023-02-15 02:01:14,405 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK] 2023-02-15 02:01:14,408 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/WALs/jenkins-hbase20.apache.org,33825,1676426474158/jenkins-hbase20.apache.org%2C33825%2C1676426474158.1676426474364 2023-02-15 02:01:14,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK], DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK]] 2023-02-15 02:01:14,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:14,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:14,409 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:14,409 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:14,410 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:14,412 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:14,413 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:14,413 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,415 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:14,419 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:14,422 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:14,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:14,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64299583, jitterRate=-0.04186154901981354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:14,425 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:14,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:14,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:14,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:14,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:14,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 02:01:14,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 02:01:14,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:14,430 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:14,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:14,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:14,442 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:14,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:14,443 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:14,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:14,445 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,445 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:14,446 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:14,447 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:14,448 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:14,448 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:14,448 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,448 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,33825,1676426474158, sessionid=0x10163ddb4440000, setting cluster-up flag (Was=false) 2023-02-15 02:01:14,451 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:14,453 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,455 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:14,456 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,457 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,460 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:14,460 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:14,461 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.hbase-snapshot/.tmp 2023-02-15 02:01:14,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:14,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:14,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:14,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:14,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:14,469 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:14,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:14,470 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,479 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426504479 2023-02-15 02:01:14,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:14,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:14,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:14,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:14,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:14,481 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:14,481 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,481 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:14,482 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:14,482 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:14,482 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:14,482 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:14,483 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:14,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:14,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:14,483 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426474483,5,FailOnTimeoutGroup] 2023-02-15 02:01:14,487 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426474483,5,FailOnTimeoutGroup] 2023-02-15 02:01:14,487 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,488 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:14,488 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,488 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,490 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(952): ClusterId : 6aa3f551-d985-4002-b937-055215c7662f 2023-02-15 02:01:14,490 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:14,490 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(952): ClusterId : 6aa3f551-d985-4002-b937-055215c7662f 2023-02-15 02:01:14,490 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:14,491 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:14,491 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:14,491 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:14,491 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:14,493 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:14,494 DEBUG [RS:1;jenkins-hbase20:34777] zookeeper.ReadOnlyZKClient(139): Connect 0x6ebe7427 to 127.0.0.1:61388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:14,494 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:14,496 DEBUG [RS:0;jenkins-hbase20:33779] zookeeper.ReadOnlyZKClient(139): Connect 0x36bf1b24 to 127.0.0.1:61388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:14,500 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:14,501 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:14,501 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777 2023-02-15 02:01:14,510 DEBUG [RS:1;jenkins-hbase20:34777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60798780, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:14,510 DEBUG [RS:0;jenkins-hbase20:33779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3878e383, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:14,510 DEBUG [RS:1;jenkins-hbase20:34777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64461f57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:14,511 DEBUG [RS:0;jenkins-hbase20:33779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c477054, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:14,519 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34777 2023-02-15 02:01:14,519 INFO [RS:1;jenkins-hbase20:34777] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:14,519 INFO [RS:1;jenkins-hbase20:34777] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:14,519 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:14,520 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33825,1676426474158 with isa=jenkins-hbase20.apache.org/148.251.75.209:34777, startcode=1676426474266 2023-02-15 02:01:14,520 DEBUG [RS:1;jenkins-hbase20:34777] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:14,522 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:14,524 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58263, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:14,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:14,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,526 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777 2023-02-15 02:01:14,526 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36269 2023-02-15 02:01:14,527 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:14,527 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:33779 2023-02-15 02:01:14,527 INFO [RS:0;jenkins-hbase20:33779] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:14,527 INFO [RS:0;jenkins-hbase20:33779] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:14,527 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:14,527 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/info 2023-02-15 02:01:14,527 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:14,528 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:14,528 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33825,1676426474158 with isa=jenkins-hbase20.apache.org/148.251.75.209:33779, startcode=1676426474226 2023-02-15 02:01:14,528 DEBUG [RS:1;jenkins-hbase20:34777] zookeeper.ZKUtil(162): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,528 DEBUG [RS:0;jenkins-hbase20:33779] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:14,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,528 WARN [RS:1;jenkins-hbase20:34777] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:14,528 INFO [RS:1;jenkins-hbase20:34777] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:14,528 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,529 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:14,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:14,537 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:14,540 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,540 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34777,1676426474266] 2023-02-15 02:01:14,540 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:14,541 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51697, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:14,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,543 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777 2023-02-15 02:01:14,543 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36269 2023-02-15 02:01:14,543 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:14,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/table 2023-02-15 02:01:14,543 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:14,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,545 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740 2023-02-15 02:01:14,545 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740 2023-02-15 02:01:14,546 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:14,546 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:14,546 DEBUG [RS:1;jenkins-hbase20:34777] zookeeper.ZKUtil(162): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,547 DEBUG [RS:0;jenkins-hbase20:33779] zookeeper.ZKUtil(162): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,547 WARN [RS:0;jenkins-hbase20:33779] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:14,547 INFO [RS:0;jenkins-hbase20:33779] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:14,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,547 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,547 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33779,1676426474226] 2023-02-15 02:01:14,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,548 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:14,548 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:14,548 INFO [RS:1;jenkins-hbase20:34777] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:14,549 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:14,555 INFO [RS:1;jenkins-hbase20:34777] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:14,557 INFO [RS:1;jenkins-hbase20:34777] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:14,557 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,557 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:14,557 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59958733, jitterRate=-0.10654525458812714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:14,557 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:14,558 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:14,558 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:14,558 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:14,558 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:14,558 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:14,562 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:14,564 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:14,564 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:14,565 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,565 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,565 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,565 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:14,565 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:14,565 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,565 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:14,565 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,565 DEBUG [RS:0;jenkins-hbase20:33779] zookeeper.ZKUtil(162): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,565 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:14,566 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,566 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,566 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,566 DEBUG [RS:0;jenkins-hbase20:33779] zookeeper.ZKUtil(162): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,566 DEBUG [RS:1;jenkins-hbase20:34777] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,567 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:14,567 INFO [RS:0;jenkins-hbase20:33779] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:14,571 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:14,575 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,576 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,576 INFO [RS:0;jenkins-hbase20:33779] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:14,576 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,576 INFO [RS:0;jenkins-hbase20:33779] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:14,576 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,576 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:14,577 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:14,578 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,578 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,578 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,578 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,578 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,579 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,579 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:14,579 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,579 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,579 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,579 DEBUG [RS:0;jenkins-hbase20:33779] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:14,584 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,584 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,584 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,590 INFO [RS:1;jenkins-hbase20:34777] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:14,590 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34777,1676426474266-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,598 INFO [RS:0;jenkins-hbase20:33779] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:14,598 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33779,1676426474226-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,604 INFO [RS:1;jenkins-hbase20:34777] regionserver.Replication(203): jenkins-hbase20.apache.org,34777,1676426474266 started 2023-02-15 02:01:14,604 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34777,1676426474266, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34777, sessionid=0x10163ddb4440002 2023-02-15 02:01:14,605 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:14,605 DEBUG [RS:1;jenkins-hbase20:34777] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,605 DEBUG [RS:1;jenkins-hbase20:34777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34777,1676426474266' 2023-02-15 02:01:14,605 DEBUG [RS:1;jenkins-hbase20:34777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:14,605 DEBUG [RS:1;jenkins-hbase20:34777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:14,606 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:14,606 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:14,606 DEBUG [RS:1;jenkins-hbase20:34777] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:14,606 DEBUG [RS:1;jenkins-hbase20:34777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34777,1676426474266' 2023-02-15 02:01:14,606 DEBUG [RS:1;jenkins-hbase20:34777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:14,606 DEBUG [RS:1;jenkins-hbase20:34777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:14,607 DEBUG [RS:1;jenkins-hbase20:34777] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:14,607 INFO [RS:1;jenkins-hbase20:34777] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:14,607 INFO [RS:1;jenkins-hbase20:34777] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:14,611 INFO [RS:0;jenkins-hbase20:33779] regionserver.Replication(203): jenkins-hbase20.apache.org,33779,1676426474226 started 2023-02-15 02:01:14,611 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33779,1676426474226, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33779, sessionid=0x10163ddb4440001 2023-02-15 02:01:14,611 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:14,611 DEBUG [RS:0;jenkins-hbase20:33779] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,611 DEBUG [RS:0;jenkins-hbase20:33779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33779,1676426474226' 2023-02-15 02:01:14,611 DEBUG [RS:0;jenkins-hbase20:33779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:14,612 DEBUG [RS:0;jenkins-hbase20:33779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:14,612 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:14,612 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:14,612 DEBUG [RS:0;jenkins-hbase20:33779] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,612 DEBUG [RS:0;jenkins-hbase20:33779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33779,1676426474226' 2023-02-15 02:01:14,612 DEBUG [RS:0;jenkins-hbase20:33779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:14,613 DEBUG [RS:0;jenkins-hbase20:33779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:14,613 DEBUG [RS:0;jenkins-hbase20:33779] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:14,613 INFO [RS:0;jenkins-hbase20:33779] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:14,613 INFO [RS:0;jenkins-hbase20:33779] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:14,728 DEBUG [jenkins-hbase20:33825] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:14,728 DEBUG [jenkins-hbase20:33825] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:14,730 DEBUG [jenkins-hbase20:33825] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:14,730 DEBUG [jenkins-hbase20:33825] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:14,730 DEBUG [jenkins-hbase20:33825] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:14,731 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,33779,1676426474226, state=OPENING 2023-02-15 02:01:14,732 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:14,733 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:14,733 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:14,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,33779,1676426474226}] 2023-02-15 02:01:14,887 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:14,887 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:14,890 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51964, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:14,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:14,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:14,896 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33779%2C1676426474226.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,33779,1676426474226, archiveDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/oldWALs, maxLogs=32 2023-02-15 02:01:14,911 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK] 2023-02-15 02:01:14,911 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK] 2023-02-15 02:01:14,913 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,33779,1676426474226/jenkins-hbase20.apache.org%2C33779%2C1676426474226.meta.1676426474897.meta 2023-02-15 02:01:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK], DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK]] 2023-02-15 02:01:14,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:14,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:14,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:14,915 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:14,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:14,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:14,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:14,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:14,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:14,920 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/info 2023-02-15 02:01:14,920 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/info 2023-02-15 02:01:14,920 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:14,921 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,921 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:14,922 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:14,922 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:14,923 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:14,923 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,924 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:14,925 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/table 2023-02-15 02:01:14,925 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/table 2023-02-15 02:01:14,925 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:14,925 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:14,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740 2023-02-15 02:01:14,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740 2023-02-15 02:01:14,929 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:14,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:14,932 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66120406, jitterRate=-0.014729171991348267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:14,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:14,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426474887 2023-02-15 02:01:14,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:14,939 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:14,939 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,33779,1676426474226, state=OPEN 2023-02-15 02:01:14,940 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:14,940 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:14,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:14,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,33779,1676426474226 in 207 msec 2023-02-15 02:01:14,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:14,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 378 msec 2023-02-15 02:01:14,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 478 msec 2023-02-15 02:01:14,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426474947, completionTime=-1 2023-02-15 02:01:14,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:14,947 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:14,950 DEBUG [hconnection-0x63a05403-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:14,954 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51966, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:14,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:14,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426534956 2023-02-15 02:01:14,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426594956 2023-02-15 02:01:14,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-15 02:01:14,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33825,1676426474158-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33825,1676426474158-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33825,1676426474158-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:33825, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:14,965 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:14,965 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:14,966 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:14,967 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:14,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:14,969 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:14,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/hbase/namespace/7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:14,972 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/hbase/namespace/7843bc849fe036501b316b476958dbdd empty. 2023-02-15 02:01:14,972 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/hbase/namespace/7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:14,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:14,986 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:14,987 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7843bc849fe036501b316b476958dbdd, NAME => 'hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,398 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,398 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7843bc849fe036501b316b476958dbdd, disabling compactions & flushes 2023-02-15 02:01:15,399 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. after waiting 0 ms 2023-02-15 02:01:15,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,399 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7843bc849fe036501b316b476958dbdd: 2023-02-15 02:01:15,401 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:15,402 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426475402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426475402"}]},"ts":"1676426475402"} 2023-02-15 02:01:15,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:15,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:15,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426475406"}]},"ts":"1676426475406"} 2023-02-15 02:01:15,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:15,410 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:15,411 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:15,411 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:15,411 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:15,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7843bc849fe036501b316b476958dbdd, ASSIGN}] 2023-02-15 02:01:15,413 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7843bc849fe036501b316b476958dbdd, ASSIGN 2023-02-15 02:01:15,414 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7843bc849fe036501b316b476958dbdd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34777,1676426474266; forceNewPlan=false, retain=false 2023-02-15 02:01:15,565 INFO [jenkins-hbase20:33825] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:15,566 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7843bc849fe036501b316b476958dbdd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:15,566 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426475566"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426475566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426475566"}]},"ts":"1676426475566"} 2023-02-15 02:01:15,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7843bc849fe036501b316b476958dbdd, server=jenkins-hbase20.apache.org,34777,1676426474266}] 2023-02-15 02:01:15,609 INFO [RS:1;jenkins-hbase20:34777] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34777%2C1676426474266, suffix=, logDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,34777,1676426474266, archiveDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/oldWALs, maxLogs=32 2023-02-15 02:01:15,615 INFO [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33779%2C1676426474226, suffix=, logDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,33779,1676426474226, archiveDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/oldWALs, maxLogs=32 2023-02-15 02:01:15,629 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK] 2023-02-15 02:01:15,632 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK] 2023-02-15 02:01:15,636 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK] 2023-02-15 02:01:15,636 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK] 2023-02-15 02:01:15,637 INFO [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,33779,1676426474226/jenkins-hbase20.apache.org%2C33779%2C1676426474226.1676426475615 2023-02-15 02:01:15,639 DEBUG [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK], DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK]] 2023-02-15 02:01:15,640 INFO [RS:1;jenkins-hbase20:34777] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/WALs/jenkins-hbase20.apache.org,34777,1676426474266/jenkins-hbase20.apache.org%2C34777%2C1676426474266.1676426475610 2023-02-15 02:01:15,640 DEBUG [RS:1;jenkins-hbase20:34777] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36955,DS-5edaa9c4-7c6c-4a11-acd8-5175eeafd1c1,DISK], DatanodeInfoWithStorage[127.0.0.1:35491,DS-8267adcb-0bec-417a-97c0-6d477fd4d8d1,DISK]] 2023-02-15 02:01:15,721 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:15,721 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:15,724 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:15,727 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7843bc849fe036501b316b476958dbdd, NAME => 'hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:15,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,728 INFO [StoreOpener-7843bc849fe036501b316b476958dbdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,730 DEBUG [StoreOpener-7843bc849fe036501b316b476958dbdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/info 2023-02-15 02:01:15,730 DEBUG [StoreOpener-7843bc849fe036501b316b476958dbdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/info 2023-02-15 02:01:15,730 INFO [StoreOpener-7843bc849fe036501b316b476958dbdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7843bc849fe036501b316b476958dbdd columnFamilyName info 2023-02-15 02:01:15,731 INFO [StoreOpener-7843bc849fe036501b316b476958dbdd-1] regionserver.HStore(310): Store=7843bc849fe036501b316b476958dbdd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:15,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:15,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:15,737 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7843bc849fe036501b316b476958dbdd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60688487, jitterRate=-0.09567107260227203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:15,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7843bc849fe036501b316b476958dbdd: 2023-02-15 02:01:15,738 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd., pid=6, masterSystemTime=1676426475721 2023-02-15 02:01:15,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,742 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:15,743 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7843bc849fe036501b316b476958dbdd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:15,743 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426475743"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426475743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426475743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426475743"}]},"ts":"1676426475743"} 2023-02-15 02:01:15,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:15,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7843bc849fe036501b316b476958dbdd, server=jenkins-hbase20.apache.org,34777,1676426474266 in 177 msec 2023-02-15 02:01:15,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:15,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7843bc849fe036501b316b476958dbdd, ASSIGN in 335 msec 2023-02-15 02:01:15,749 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:15,749 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426475749"}]},"ts":"1676426475749"} 2023-02-15 02:01:15,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:15,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:15,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 787 msec 2023-02-15 02:01:15,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:15,768 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:15,768 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:15,772 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:15,773 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:15,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:15,787 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:15,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-15 02:01:15,799 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:15,807 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:15,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-15 02:01:15,822 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:15,824 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:15,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.528sec 2023-02-15 02:01:15,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:15,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:15,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:15,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33825,1676426474158-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:15,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33825,1676426474158-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:15,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:15,890 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ReadOnlyZKClient(139): Connect 0x03297095 to 127.0.0.1:61388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:15,895 DEBUG [Listener at localhost.localdomain/34749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2645cb6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:15,896 DEBUG [hconnection-0x1a3f24ad-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:15,898 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:15,899 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:15,900 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:15,902 DEBUG [Listener at localhost.localdomain/34749] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:15,903 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59382, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:15,904 INFO [Listener at localhost.localdomain/34749] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 02:01:15,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-15 02:01:15,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:15,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 148.251.75.209:59382 deadline: 1676426535904, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 02:01:15,905 INFO [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 02:01:15,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:15,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 02:01:15,911 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:15,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 02:01:15,912 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:15,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:15,920 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891 empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34 empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48 empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488 empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae empty. 2023-02-15 02:01:15,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9 empty. 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:15,922 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7 empty. 2023-02-15 02:01:15,923 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4 empty. 2023-02-15 02:01:15,923 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:15,923 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:15,923 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:15,923 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 02:01:15,931 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:15,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0eb976d3b25f104b73093404f1721891, NAME => 'testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => abff50fd1e71f3c8338ef0ccde1ee1ae, NAME => 'testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 696219e0e10705905a593dcaa4bd95b9, NAME => 'testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 696219e0e10705905a593dcaa4bd95b9, disabling compactions & flushes 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0eb976d3b25f104b73093404f1721891, disabling compactions & flushes 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing abff50fd1e71f3c8338ef0ccde1ee1ae, disabling compactions & flushes 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. after waiting 0 ms 2023-02-15 02:01:15,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:15,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:15,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:15,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. after waiting 0 ms 2023-02-15 02:01:15,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:15,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:15,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:15,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f655a63d1336202d5820ee1e42709a34, NAME => 'testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. after waiting 0 ms 2023-02-15 02:01:15,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:15,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5d1d47ae698ddd33c3ee1f8a6d28901c, NAME => 'testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:15,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:15,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5da70eeadd1ceada3da57917e922df48, NAME => 'testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 5d1d47ae698ddd33c3ee1f8a6d28901c, disabling compactions & flushes 2023-02-15 02:01:15,953 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. after waiting 0 ms 2023-02-15 02:01:15,954 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:15,954 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:15,954 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:15,954 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b646a8e95a92ebc86853666a8adb2488, NAME => 'testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f655a63d1336202d5820ee1e42709a34, disabling compactions & flushes 2023-02-15 02:01:15,955 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. after waiting 0 ms 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:15,955 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:15,955 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9acb08c021afed1a4929a62c0a92ce6e, NAME => 'testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5da70eeadd1ceada3da57917e922df48, disabling compactions & flushes 2023-02-15 02:01:15,955 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:15,955 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. after waiting 0 ms 2023-02-15 02:01:15,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:15,956 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:15,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:15,956 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8829ca9f56c3e37040e5191b1aec1ac4, NAME => 'testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b646a8e95a92ebc86853666a8adb2488, disabling compactions & flushes 2023-02-15 02:01:15,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:15,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:15,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. after waiting 0 ms 2023-02-15 02:01:15,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:15,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:15,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:15,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a8adaad31c62ab398e3e0d4c64b989a7, NAME => 'testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.tmp 2023-02-15 02:01:15,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8829ca9f56c3e37040e5191b1aec1ac4, disabling compactions & flushes 2023-02-15 02:01:15,968 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:15,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:15,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. after waiting 0 ms 2023-02-15 02:01:15,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:15,968 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:15,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:15,974 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:15,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a8adaad31c62ab398e3e0d4c64b989a7, disabling compactions & flushes 2023-02-15 02:01:15,975 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:15,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:15,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. after waiting 0 ms 2023-02-15 02:01:15,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:15,975 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:15,975 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:16,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:16,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:16,367 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9acb08c021afed1a4929a62c0a92ce6e, disabling compactions & flushes 2023-02-15 02:01:16,368 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. after waiting 0 ms 2023-02-15 02:01:16,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,368 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:16,370 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:16,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676426475907.0eb976d3b25f104b73093404f1721891.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426476371"}]},"ts":"1676426476371"} 2023-02-15 02:01:16,374 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 02:01:16,375 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:16,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426476375"}]},"ts":"1676426476375"} 2023-02-15 02:01:16,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 02:01:16,379 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:16,387 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:16,387 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:16,387 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:16,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=696219e0e10705905a593dcaa4bd95b9, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=abff50fd1e71f3c8338ef0ccde1ee1ae, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0eb976d3b25f104b73093404f1721891, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f655a63d1336202d5820ee1e42709a34, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5d1d47ae698ddd33c3ee1f8a6d28901c, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5da70eeadd1ceada3da57917e922df48, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b646a8e95a92ebc86853666a8adb2488, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9acb08c021afed1a4929a62c0a92ce6e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8829ca9f56c3e37040e5191b1aec1ac4, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a8adaad31c62ab398e3e0d4c64b989a7, ASSIGN}] 2023-02-15 02:01:16,389 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=696219e0e10705905a593dcaa4bd95b9, ASSIGN 2023-02-15 02:01:16,389 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0eb976d3b25f104b73093404f1721891, ASSIGN 2023-02-15 02:01:16,390 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=abff50fd1e71f3c8338ef0ccde1ee1ae, ASSIGN 2023-02-15 02:01:16,390 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f655a63d1336202d5820ee1e42709a34, ASSIGN 2023-02-15 02:01:16,390 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=696219e0e10705905a593dcaa4bd95b9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34777,1676426474266; forceNewPlan=false, retain=false 2023-02-15 02:01:16,391 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0eb976d3b25f104b73093404f1721891, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33779,1676426474226; forceNewPlan=false, retain=false 2023-02-15 02:01:16,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a8adaad31c62ab398e3e0d4c64b989a7, ASSIGN 2023-02-15 02:01:16,391 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f655a63d1336202d5820ee1e42709a34, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34777,1676426474266; forceNewPlan=false, retain=false 2023-02-15 02:01:16,391 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=abff50fd1e71f3c8338ef0ccde1ee1ae, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34777,1676426474266; forceNewPlan=false, retain=false 2023-02-15 02:01:16,392 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8829ca9f56c3e37040e5191b1aec1ac4, ASSIGN 2023-02-15 02:01:16,392 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9acb08c021afed1a4929a62c0a92ce6e, ASSIGN 2023-02-15 02:01:16,392 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a8adaad31c62ab398e3e0d4c64b989a7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34777,1676426474266; forceNewPlan=false, retain=false 2023-02-15 02:01:16,392 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b646a8e95a92ebc86853666a8adb2488, ASSIGN 2023-02-15 02:01:16,392 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5da70eeadd1ceada3da57917e922df48, ASSIGN 2023-02-15 02:01:16,393 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8829ca9f56c3e37040e5191b1aec1ac4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33779,1676426474226; forceNewPlan=false, retain=false 2023-02-15 02:01:16,393 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9acb08c021afed1a4929a62c0a92ce6e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33779,1676426474226; forceNewPlan=false, retain=false 2023-02-15 02:01:16,393 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5d1d47ae698ddd33c3ee1f8a6d28901c, ASSIGN 2023-02-15 02:01:16,394 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b646a8e95a92ebc86853666a8adb2488, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34777,1676426474266; forceNewPlan=false, retain=false 2023-02-15 02:01:16,394 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5d1d47ae698ddd33c3ee1f8a6d28901c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33779,1676426474226; forceNewPlan=false, retain=false 2023-02-15 02:01:16,394 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5da70eeadd1ceada3da57917e922df48, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33779,1676426474226; forceNewPlan=false, retain=false 2023-02-15 02:01:16,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:16,541 INFO [jenkins-hbase20:33825] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 02:01:16,544 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b646a8e95a92ebc86853666a8adb2488, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,544 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a8adaad31c62ab398e3e0d4c64b989a7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,544 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=696219e0e10705905a593dcaa4bd95b9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f655a63d1336202d5820ee1e42709a34, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,544 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426476544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476544"}]},"ts":"1676426476544"} 2023-02-15 02:01:16,544 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476544"}]},"ts":"1676426476544"} 2023-02-15 02:01:16,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=abff50fd1e71f3c8338ef0ccde1ee1ae, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,544 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426476544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476544"}]},"ts":"1676426476544"} 2023-02-15 02:01:16,544 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476544"}]},"ts":"1676426476544"} 2023-02-15 02:01:16,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476544"}]},"ts":"1676426476544"} 2023-02-15 02:01:16,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure f655a63d1336202d5820ee1e42709a34, server=jenkins-hbase20.apache.org,34777,1676426474266}] 2023-02-15 02:01:16,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure a8adaad31c62ab398e3e0d4c64b989a7, server=jenkins-hbase20.apache.org,34777,1676426474266}] 2023-02-15 02:01:16,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 696219e0e10705905a593dcaa4bd95b9, server=jenkins-hbase20.apache.org,34777,1676426474266}] 2023-02-15 02:01:16,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure b646a8e95a92ebc86853666a8adb2488, server=jenkins-hbase20.apache.org,34777,1676426474266}] 2023-02-15 02:01:16,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure abff50fd1e71f3c8338ef0ccde1ee1ae, server=jenkins-hbase20.apache.org,34777,1676426474266}] 2023-02-15 02:01:16,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5d1d47ae698ddd33c3ee1f8a6d28901c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476551"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476551"}]},"ts":"1676426476551"} 2023-02-15 02:01:16,553 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9acb08c021afed1a4929a62c0a92ce6e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,553 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476553"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476553"}]},"ts":"1676426476553"} 2023-02-15 02:01:16,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0eb976d3b25f104b73093404f1721891, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676426475907.0eb976d3b25f104b73093404f1721891.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476553"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476553"}]},"ts":"1676426476553"} 2023-02-15 02:01:16,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5da70eeadd1ceada3da57917e922df48, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476555"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476555"}]},"ts":"1676426476555"} 2023-02-15 02:01:16,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 5d1d47ae698ddd33c3ee1f8a6d28901c, server=jenkins-hbase20.apache.org,33779,1676426474226}] 2023-02-15 02:01:16,557 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8829ca9f56c3e37040e5191b1aec1ac4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476557"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426476557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426476557"}]},"ts":"1676426476557"} 2023-02-15 02:01:16,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 9acb08c021afed1a4929a62c0a92ce6e, server=jenkins-hbase20.apache.org,33779,1676426474226}] 2023-02-15 02:01:16,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 0eb976d3b25f104b73093404f1721891, server=jenkins-hbase20.apache.org,33779,1676426474226}] 2023-02-15 02:01:16,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure 5da70eeadd1ceada3da57917e922df48, server=jenkins-hbase20.apache.org,33779,1676426474226}] 2023-02-15 02:01:16,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 8829ca9f56c3e37040e5191b1aec1ac4, server=jenkins-hbase20.apache.org,33779,1676426474226}] 2023-02-15 02:01:16,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:16,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a8adaad31c62ab398e3e0d4c64b989a7, NAME => 'testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 02:01:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,704 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,706 DEBUG [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/f1 2023-02-15 02:01:16,706 DEBUG [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/f1 2023-02-15 02:01:16,706 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8adaad31c62ab398e3e0d4c64b989a7 columnFamilyName f1 2023-02-15 02:01:16,707 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(310): Store=a8adaad31c62ab398e3e0d4c64b989a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,707 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,708 DEBUG [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/f2 2023-02-15 02:01:16,708 DEBUG [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/f2 2023-02-15 02:01:16,708 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8adaad31c62ab398e3e0d4c64b989a7 columnFamilyName f2 2023-02-15 02:01:16,709 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(310): Store=a8adaad31c62ab398e3e0d4c64b989a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:16,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d1d47ae698ddd33c3ee1f8a6d28901c, NAME => 'testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 02:01:16,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:16,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,715 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,716 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1 2023-02-15 02:01:16,717 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1 2023-02-15 02:01:16,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened a8adaad31c62ab398e3e0d4c64b989a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61778708, jitterRate=-0.07942551374435425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,717 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d1d47ae698ddd33c3ee1f8a6d28901c columnFamilyName f1 2023-02-15 02:01:16,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:16,717 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(310): Store=5d1d47ae698ddd33c3ee1f8a6d28901c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,718 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7., pid=22, masterSystemTime=1676426476698 2023-02-15 02:01:16,719 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2 2023-02-15 02:01:16,719 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2 2023-02-15 02:01:16,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:16,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:16,720 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d1d47ae698ddd33c3ee1f8a6d28901c columnFamilyName f2 2023-02-15 02:01:16,720 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a8adaad31c62ab398e3e0d4c64b989a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,720 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426476720"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476720"}]},"ts":"1676426476720"} 2023-02-15 02:01:16,720 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(310): Store=5d1d47ae698ddd33c3ee1f8a6d28901c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 696219e0e10705905a593dcaa4bd95b9, NAME => 'testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 02:01:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,723 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,724 DEBUG [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/f1 2023-02-15 02:01:16,724 DEBUG [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/f1 2023-02-15 02:01:16,725 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 696219e0e10705905a593dcaa4bd95b9 columnFamilyName f1 2023-02-15 02:01:16,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-15 02:01:16,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure a8adaad31c62ab398e3e0d4c64b989a7, server=jenkins-hbase20.apache.org,34777,1676426474266 in 175 msec 2023-02-15 02:01:16,725 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(310): Store=696219e0e10705905a593dcaa4bd95b9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:16,726 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a8adaad31c62ab398e3e0d4c64b989a7, ASSIGN in 338 msec 2023-02-15 02:01:16,728 DEBUG [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/f2 2023-02-15 02:01:16,728 DEBUG [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/f2 2023-02-15 02:01:16,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,729 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 696219e0e10705905a593dcaa4bd95b9 columnFamilyName f2 2023-02-15 02:01:16,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5d1d47ae698ddd33c3ee1f8a6d28901c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65203308, jitterRate=-0.028394997119903564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:16,729 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(310): Store=696219e0e10705905a593dcaa4bd95b9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c., pid=26, masterSystemTime=1676426476709 2023-02-15 02:01:16,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:16,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:16,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5d1d47ae698ddd33c3ee1f8a6d28901c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9acb08c021afed1a4929a62c0a92ce6e, NAME => 'testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 02:01:16,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476732"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476732"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476732"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476732"}]},"ts":"1676426476732"} 2023-02-15 02:01:16,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:16,734 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,736 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1 2023-02-15 02:01:16,736 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1 2023-02-15 02:01:16,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-15 02:01:16,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 5d1d47ae698ddd33c3ee1f8a6d28901c, server=jenkins-hbase20.apache.org,33779,1676426474226 in 179 msec 2023-02-15 02:01:16,737 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9acb08c021afed1a4929a62c0a92ce6e columnFamilyName f1 2023-02-15 02:01:16,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5d1d47ae698ddd33c3ee1f8a6d28901c, ASSIGN in 349 msec 2023-02-15 02:01:16,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,739 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(310): Store=9acb08c021afed1a4929a62c0a92ce6e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,739 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 696219e0e10705905a593dcaa4bd95b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66218349, jitterRate=-0.013269707560539246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:16,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9., pid=23, masterSystemTime=1676426476698 2023-02-15 02:01:16,741 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2 2023-02-15 02:01:16,741 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2 2023-02-15 02:01:16,741 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9acb08c021afed1a4929a62c0a92ce6e columnFamilyName f2 2023-02-15 02:01:16,742 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(310): Store=9acb08c021afed1a4929a62c0a92ce6e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:16,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:16,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:16,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => abff50fd1e71f3c8338ef0ccde1ee1ae, NAME => 'testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 02:01:16,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,743 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=696219e0e10705905a593dcaa4bd95b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,743 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676426476743"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476743"}]},"ts":"1676426476743"} 2023-02-15 02:01:16,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,745 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,746 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1 2023-02-15 02:01:16,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,746 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1 2023-02-15 02:01:16,747 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abff50fd1e71f3c8338ef0ccde1ee1ae columnFamilyName f1 2023-02-15 02:01:16,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-15 02:01:16,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 696219e0e10705905a593dcaa4bd95b9, server=jenkins-hbase20.apache.org,34777,1676426474266 in 198 msec 2023-02-15 02:01:16,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:16,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=696219e0e10705905a593dcaa4bd95b9, ASSIGN in 360 msec 2023-02-15 02:01:16,749 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(310): Store=abff50fd1e71f3c8338ef0ccde1ee1ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,749 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,750 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2 2023-02-15 02:01:16,750 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2 2023-02-15 02:01:16,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9acb08c021afed1a4929a62c0a92ce6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69057564, jitterRate=0.029037892818450928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:16,751 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abff50fd1e71f3c8338ef0ccde1ee1ae columnFamilyName f2 2023-02-15 02:01:16,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e., pid=27, masterSystemTime=1676426476709 2023-02-15 02:01:16,751 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(310): Store=abff50fd1e71f3c8338ef0ccde1ee1ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:16,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0eb976d3b25f104b73093404f1721891, NAME => 'testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 02:01:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,758 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9acb08c021afed1a4929a62c0a92ce6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476757"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476757"}]},"ts":"1676426476757"} 2023-02-15 02:01:16,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened abff50fd1e71f3c8338ef0ccde1ee1ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64416292, jitterRate=-0.04012244939804077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:16,759 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae., pid=25, masterSystemTime=1676426476698 2023-02-15 02:01:16,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:16,761 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1 2023-02-15 02:01:16,761 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1 2023-02-15 02:01:16,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:16,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:16,761 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=abff50fd1e71f3c8338ef0ccde1ee1ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,761 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eb976d3b25f104b73093404f1721891 columnFamilyName f1 2023-02-15 02:01:16,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b646a8e95a92ebc86853666a8adb2488, NAME => 'testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 02:01:16,761 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476761"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476761"}]},"ts":"1676426476761"} 2023-02-15 02:01:16,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-15 02:01:16,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 9acb08c021afed1a4929a62c0a92ce6e, server=jenkins-hbase20.apache.org,33779,1676426474226 in 202 msec 2023-02-15 02:01:16,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,762 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(310): Store=0eb976d3b25f104b73093404f1721891/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,763 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9acb08c021afed1a4929a62c0a92ce6e, ASSIGN in 375 msec 2023-02-15 02:01:16,764 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,764 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2 2023-02-15 02:01:16,765 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2 2023-02-15 02:01:16,765 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eb976d3b25f104b73093404f1721891 columnFamilyName f2 2023-02-15 02:01:16,766 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(310): Store=0eb976d3b25f104b73093404f1721891/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-15 02:01:16,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure abff50fd1e71f3c8338ef0ccde1ee1ae, server=jenkins-hbase20.apache.org,34777,1676426474266 in 214 msec 2023-02-15 02:01:16,767 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1 2023-02-15 02:01:16,767 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1 2023-02-15 02:01:16,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=abff50fd1e71f3c8338ef0ccde1ee1ae, ASSIGN in 380 msec 2023-02-15 02:01:16,768 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b646a8e95a92ebc86853666a8adb2488 columnFamilyName f1 2023-02-15 02:01:16,769 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(310): Store=b646a8e95a92ebc86853666a8adb2488/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,769 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,770 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2 2023-02-15 02:01:16,770 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2 2023-02-15 02:01:16,771 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b646a8e95a92ebc86853666a8adb2488 columnFamilyName f2 2023-02-15 02:01:16,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:16,771 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(310): Store=b646a8e95a92ebc86853666a8adb2488/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0eb976d3b25f104b73093404f1721891; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69206982, jitterRate=0.03126439452171326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:16,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891., pid=28, masterSystemTime=1676426476709 2023-02-15 02:01:16,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:16,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:16,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:16,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:16,777 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0eb976d3b25f104b73093404f1721891, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8829ca9f56c3e37040e5191b1aec1ac4, NAME => 'testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 02:01:16,777 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676426475907.0eb976d3b25f104b73093404f1721891.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476777"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476777"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476777"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476777"}]},"ts":"1676426476777"} 2023-02-15 02:01:16,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,779 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b646a8e95a92ebc86853666a8adb2488; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64488320, jitterRate=-0.03904914855957031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:16,781 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1 2023-02-15 02:01:16,781 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1 2023-02-15 02:01:16,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-15 02:01:16,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 0eb976d3b25f104b73093404f1721891, server=jenkins-hbase20.apache.org,33779,1676426474226 in 220 msec 2023-02-15 02:01:16,782 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8829ca9f56c3e37040e5191b1aec1ac4 columnFamilyName f1 2023-02-15 02:01:16,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488., pid=24, masterSystemTime=1676426476698 2023-02-15 02:01:16,783 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(310): Store=8829ca9f56c3e37040e5191b1aec1ac4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,783 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0eb976d3b25f104b73093404f1721891, ASSIGN in 395 msec 2023-02-15 02:01:16,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:16,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:16,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:16,785 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b646a8e95a92ebc86853666a8adb2488, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f655a63d1336202d5820ee1e42709a34, NAME => 'testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 02:01:16,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476784"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476784"}]},"ts":"1676426476784"} 2023-02-15 02:01:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,785 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2 2023-02-15 02:01:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,785 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2 2023-02-15 02:01:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,786 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8829ca9f56c3e37040e5191b1aec1ac4 columnFamilyName f2 2023-02-15 02:01:16,787 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(310): Store=8829ca9f56c3e37040e5191b1aec1ac4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,787 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,789 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1 2023-02-15 02:01:16,789 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1 2023-02-15 02:01:16,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-15 02:01:16,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure b646a8e95a92ebc86853666a8adb2488, server=jenkins-hbase20.apache.org,34777,1676426474266 in 239 msec 2023-02-15 02:01:16,790 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f655a63d1336202d5820ee1e42709a34 columnFamilyName f1 2023-02-15 02:01:16,791 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(310): Store=f655a63d1336202d5820ee1e42709a34/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,792 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b646a8e95a92ebc86853666a8adb2488, ASSIGN in 403 msec 2023-02-15 02:01:16,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:16,793 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2 2023-02-15 02:01:16,793 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2 2023-02-15 02:01:16,794 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f655a63d1336202d5820ee1e42709a34 columnFamilyName f2 2023-02-15 02:01:16,795 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(310): Store=f655a63d1336202d5820ee1e42709a34/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8829ca9f56c3e37040e5191b1aec1ac4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75288872, jitterRate=0.12189161777496338}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:16,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4., pid=30, masterSystemTime=1676426476709 2023-02-15 02:01:16,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:16,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:16,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:16,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5da70eeadd1ceada3da57917e922df48, NAME => 'testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 02:01:16,801 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8829ca9f56c3e37040e5191b1aec1ac4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:16,801 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476801"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476801"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476801"}]},"ts":"1676426476801"} 2023-02-15 02:01:16,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,803 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:16,804 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1 2023-02-15 02:01:16,804 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1 2023-02-15 02:01:16,805 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5da70eeadd1ceada3da57917e922df48 columnFamilyName f1 2023-02-15 02:01:16,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-15 02:01:16,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 8829ca9f56c3e37040e5191b1aec1ac4, server=jenkins-hbase20.apache.org,33779,1676426474226 in 242 msec 2023-02-15 02:01:16,805 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(310): Store=5da70eeadd1ceada3da57917e922df48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,805 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f655a63d1336202d5820ee1e42709a34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66107977, jitterRate=-0.014914378523826599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:16,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34., pid=21, masterSystemTime=1676426476698 2023-02-15 02:01:16,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8829ca9f56c3e37040e5191b1aec1ac4, ASSIGN in 418 msec 2023-02-15 02:01:16,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:16,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:16,809 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2 2023-02-15 02:01:16,809 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2 2023-02-15 02:01:16,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f655a63d1336202d5820ee1e42709a34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:16,809 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5da70eeadd1ceada3da57917e922df48 columnFamilyName f2 2023-02-15 02:01:16,809 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476809"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476809"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476809"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476809"}]},"ts":"1676426476809"} 2023-02-15 02:01:16,810 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(310): Store=5da70eeadd1ceada3da57917e922df48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:16,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:16,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-15 02:01:16,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure f655a63d1336202d5820ee1e42709a34, server=jenkins-hbase20.apache.org,34777,1676426474266 in 265 msec 2023-02-15 02:01:16,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f655a63d1336202d5820ee1e42709a34, ASSIGN in 426 msec 2023-02-15 02:01:16,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:16,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:16,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5da70eeadd1ceada3da57917e922df48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66719816, jitterRate=-0.005797266960144043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:16,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:16,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48., pid=29, masterSystemTime=1676426476709 2023-02-15 02:01:16,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:16,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:16,820 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5da70eeadd1ceada3da57917e922df48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:16,820 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676426476820"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426476820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426476820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426476820"}]},"ts":"1676426476820"} 2023-02-15 02:01:16,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-15 02:01:16,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure 5da70eeadd1ceada3da57917e922df48, server=jenkins-hbase20.apache.org,33779,1676426474226 in 262 msec 2023-02-15 02:01:16,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-15 02:01:16,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5da70eeadd1ceada3da57917e922df48, ASSIGN in 437 msec 2023-02-15 02:01:16,826 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:16,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426476826"}]},"ts":"1676426476826"} 2023-02-15 02:01:16,827 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 02:01:16,830 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:16,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 922 msec 2023-02-15 02:01:17,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:17,020 INFO [Listener at localhost.localdomain/34749] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 02:01:17,020 DEBUG [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 02:01:17,020 INFO [Listener at localhost.localdomain/34749] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:17,023 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 02:01:17,024 INFO [Listener at localhost.localdomain/34749] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:17,024 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 02:01:17,024 INFO [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:17,083 DEBUG [hconnection-0x1a3f24ad-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:17,093 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43964, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:17,106 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34777] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:17,121 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33779] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:17,288 INFO [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:17,289 INFO [Listener at localhost.localdomain/34749] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:17,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:17,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426477290 (current time:1676426477290). 2023-02-15 02:01:17,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:17,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] zookeeper.ReadOnlyZKClient(139): Connect 0x70f97eac to 127.0.0.1:61388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:17,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37dfbf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:17,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:17,297 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51990, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70f97eac to 127.0.0.1:61388 2023-02-15 02:01:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:17,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:17,302 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:17,303 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676427077303 2023-02-15 02:01:17,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:17,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 02:01:17,304 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:17,304 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:17,304 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:17,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:17,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 3 msec 2023-02-15 02:01:17,306 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:17,307 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676427077307 2023-02-15 02:01:17,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,323 INFO [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-15 02:01:17,323 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:17,324 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-15 02:01:17,324 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-15 02:01:17,324 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,325 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,325 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:17,325 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:17,325 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:17,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:17,326 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,326 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,326 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,326 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 02:01:17,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,327 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 02:01:17,327 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 02:01:17,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,328 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 02:01:17,328 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:17,328 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34777,1676426474266' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 02:01:17,329 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33779,1676426474226' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 02:01:17,330 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,330 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:17,331 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,331 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:17,331 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,331 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:17,331 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,331 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34777,1676426474266' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34ba3e5[Count = 1] remaining members to acquire global barrier 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:17,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33779,1676426474226' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 02:01:17,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34ba3e5[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:17,334 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-15 02:01:17,334 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,335 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:17,335 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:17,335 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. started... 2023-02-15 02:01:17,335 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:17,335 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 02:01:17,336 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:17,336 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:17,336 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. started... 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. started... 2023-02-15 02:01:17,336 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 02:01:17,337 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:17,337 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9acb08c021afed1a4929a62c0a92ce6e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:17,336 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:17,335 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:17,335 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. started... 2023-02-15 02:01:17,337 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f655a63d1336202d5820ee1e42709a34 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:17,338 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,338 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,338 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:17,338 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:17,336 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. started... 2023-02-15 02:01:17,336 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. started... 2023-02-15 02:01:17,336 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:17,344 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HRegion(2744): Flushing abff50fd1e71f3c8338ef0ccde1ee1ae 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 02:01:17,344 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8829ca9f56c3e37040e5191b1aec1ac4 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 02:01:17,338 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5d1d47ae698ddd33c3ee1f8a6d28901c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:17,383 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. completed. 2023-02-15 02:01:17,383 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:17,383 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:17,383 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 02:01:17,383 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. started... 2023-02-15 02:01:17,392 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:17,393 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,393 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,393 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:17,393 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:17,406 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:17,406 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f1/35d66375d2fe4de3acdd615cacae8182 2023-02-15 02:01:17,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:17,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:17,408 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:17,422 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f1/05eaeed7210b4b4b98628f3f61130131 2023-02-15 02:01:17,423 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f1/d55813358db14c9fb5c5a22b1ffb0752 2023-02-15 02:01:17,427 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f1/98d1da3eda74403e91a2b7c8b35095ff 2023-02-15 02:01:17,439 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. completed. 2023-02-15 02:01:17,439 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:17,439 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:17,439 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 02:01:17,439 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. started... 2023-02-15 02:01:17,440 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b646a8e95a92ebc86853666a8adb2488 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:17,450 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f1/aa173a43f34f40a2a6483cb37cadf8a2 2023-02-15 02:01:17,463 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f2/1f3b286eba7741a3906e3ce12e51558b 2023-02-15 02:01:17,473 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f1/35d66375d2fe4de3acdd615cacae8182 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/35d66375d2fe4de3acdd615cacae8182 2023-02-15 02:01:17,479 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/35d66375d2fe4de3acdd615cacae8182, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,480 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f2/1f3b286eba7741a3906e3ce12e51558b as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/1f3b286eba7741a3906e3ce12e51558b 2023-02-15 02:01:17,491 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f2/2d81a9bdcf8245f4982e68180be03707 2023-02-15 02:01:17,498 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f1/98d1da3eda74403e91a2b7c8b35095ff as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/98d1da3eda74403e91a2b7c8b35095ff 2023-02-15 02:01:17,499 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f2/05b56fc1a6e244bfb83d4212cf501957 2023-02-15 02:01:17,499 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f1/7bf8ee2079544e6ab1a1aaef9a3b0acc 2023-02-15 02:01:17,511 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/1f3b286eba7741a3906e3ce12e51558b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,512 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9acb08c021afed1a4929a62c0a92ce6e in 175ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,512 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/35d66375d2fe4de3acdd615cacae8182] hfiles 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/35d66375d2fe4de3acdd615cacae8182 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/1f3b286eba7741a3906e3ce12e51558b] hfiles 2023-02-15 02:01:17,513 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/1f3b286eba7741a3906e3ce12e51558b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,516 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f2/2423c72b7f4548f2a0790d5b118f185b 2023-02-15 02:01:17,520 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f2/a1fce17d148b48778f03b8d74ff3a783 2023-02-15 02:01:17,524 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/98d1da3eda74403e91a2b7c8b35095ff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,524 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f1/05eaeed7210b4b4b98628f3f61130131 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/05eaeed7210b4b4b98628f3f61130131 2023-02-15 02:01:17,527 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f2/2d81a9bdcf8245f4982e68180be03707 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/2d81a9bdcf8245f4982e68180be03707 2023-02-15 02:01:17,530 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. completed. 2023-02-15 02:01:17,530 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:17,530 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:17,530 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. started... 2023-02-15 02:01:17,530 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5da70eeadd1ceada3da57917e922df48 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:17,531 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f1/d55813358db14c9fb5c5a22b1ffb0752 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/d55813358db14c9fb5c5a22b1ffb0752 2023-02-15 02:01:17,531 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 02:01:17,532 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f1/aa173a43f34f40a2a6483cb37cadf8a2 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/aa173a43f34f40a2a6483cb37cadf8a2 2023-02-15 02:01:17,537 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/05eaeed7210b4b4b98628f3f61130131, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:17,539 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f2/05b56fc1a6e244bfb83d4212cf501957 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/05b56fc1a6e244bfb83d4212cf501957 2023-02-15 02:01:17,540 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/2d81a9bdcf8245f4982e68180be03707, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,541 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f655a63d1336202d5820ee1e42709a34 in 204ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/98d1da3eda74403e91a2b7c8b35095ff] hfiles 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/98d1da3eda74403e91a2b7c8b35095ff for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/2d81a9bdcf8245f4982e68180be03707] hfiles 2023-02-15 02:01:17,544 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/2d81a9bdcf8245f4982e68180be03707 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,547 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/aa173a43f34f40a2a6483cb37cadf8a2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:17,552 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f2/a1fce17d148b48778f03b8d74ff3a783 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/a1fce17d148b48778f03b8d74ff3a783 2023-02-15 02:01:17,560 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/d55813358db14c9fb5c5a22b1ffb0752, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,561 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/05b56fc1a6e244bfb83d4212cf501957, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:17,561 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f2/6639f638f54043cdaeeea80b3cb303a7 2023-02-15 02:01:17,563 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for abff50fd1e71f3c8338ef0ccde1ee1ae in 219ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/05eaeed7210b4b4b98628f3f61130131] hfiles 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/05eaeed7210b4b4b98628f3f61130131 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/05b56fc1a6e244bfb83d4212cf501957] hfiles 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/05b56fc1a6e244bfb83d4212cf501957 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,563 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f2/2423c72b7f4548f2a0790d5b118f185b as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/2423c72b7f4548f2a0790d5b118f185b 2023-02-15 02:01:17,574 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f1/7bf8ee2079544e6ab1a1aaef9a3b0acc as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/7bf8ee2079544e6ab1a1aaef9a3b0acc 2023-02-15 02:01:17,589 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/7bf8ee2079544e6ab1a1aaef9a3b0acc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,590 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/a1fce17d148b48778f03b8d74ff3a783, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f2/6639f638f54043cdaeeea80b3cb303a7 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/6639f638f54043cdaeeea80b3cb303a7 2023-02-15 02:01:17,591 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8829ca9f56c3e37040e5191b1aec1ac4 in 247ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/aa173a43f34f40a2a6483cb37cadf8a2] hfiles 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/aa173a43f34f40a2a6483cb37cadf8a2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/a1fce17d148b48778f03b8d74ff3a783] hfiles 2023-02-15 02:01:17,591 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/a1fce17d148b48778f03b8d74ff3a783 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,597 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. completed. 2023-02-15 02:01:17,597 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:17,597 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 02:01:17,597 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f1/529ee9a3db504041a78e7238f6014fb0 2023-02-15 02:01:17,597 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/6639f638f54043cdaeeea80b3cb303a7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,599 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b646a8e95a92ebc86853666a8adb2488 in 160ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,599 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:17,599 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/2423c72b7f4548f2a0790d5b118f185b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,599 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,599 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,599 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/7bf8ee2079544e6ab1a1aaef9a3b0acc] hfiles 2023-02-15 02:01:17,599 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/7bf8ee2079544e6ab1a1aaef9a3b0acc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,600 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/6639f638f54043cdaeeea80b3cb303a7] hfiles 2023-02-15 02:01:17,600 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/6639f638f54043cdaeeea80b3cb303a7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,600 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5d1d47ae698ddd33c3ee1f8a6d28901c in 263ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,600 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:17,600 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,600 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,601 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/d55813358db14c9fb5c5a22b1ffb0752] hfiles 2023-02-15 02:01:17,601 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/d55813358db14c9fb5c5a22b1ffb0752 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,601 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/2423c72b7f4548f2a0790d5b118f185b] hfiles 2023-02-15 02:01:17,601 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/2423c72b7f4548f2a0790d5b118f185b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,603 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. completed. 2023-02-15 02:01:17,603 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:17,603 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 02:01:17,608 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:17,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:17,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:17,609 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 02:01:17,618 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. completed. 2023-02-15 02:01:17,618 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:17,618 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:17,618 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 02:01:17,618 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. started... 2023-02-15 02:01:17,619 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0eb976d3b25f104b73093404f1721891 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:17,630 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. completed. 2023-02-15 02:01:17,630 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:17,630 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 02:01:17,630 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f2/74f75719727342feb43429950b294c45 2023-02-15 02:01:17,634 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. completed. 2023-02-15 02:01:17,634 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:17,634 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 02:01:17,634 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 02:01:17,634 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,635 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 02:01:17,635 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,34777,1676426474266' in zk 2023-02-15 02:01:17,636 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,636 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 02:01:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:17,636 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:17,636 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 02:01:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,637 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f1/529ee9a3db504041a78e7238f6014fb0 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/529ee9a3db504041a78e7238f6014fb0 2023-02-15 02:01:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,643 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f1/0b43ec896aa142f2904bd41f012fef19 2023-02-15 02:01:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,34777,1676426474266': 2023-02-15 02:01:17,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34777,1676426474266' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 02:01:17,646 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/529ee9a3db504041a78e7238f6014fb0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,647 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f2/74f75719727342feb43429950b294c45 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/74f75719727342feb43429950b294c45 2023-02-15 02:01:17,652 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/74f75719727342feb43429950b294c45, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,653 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5da70eeadd1ceada3da57917e922df48 in 123ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,653 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:17,653 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,653 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,653 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/529ee9a3db504041a78e7238f6014fb0] hfiles 2023-02-15 02:01:17,653 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/529ee9a3db504041a78e7238f6014fb0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,654 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/74f75719727342feb43429950b294c45] hfiles 2023-02-15 02:01:17,654 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/74f75719727342feb43429950b294c45 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,669 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. completed. 2023-02-15 02:01:17,670 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 02:01:17,673 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f2/5c4e8614fbd0449496f11d3607f85756 2023-02-15 02:01:17,679 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f1/0b43ec896aa142f2904bd41f012fef19 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/0b43ec896aa142f2904bd41f012fef19 2023-02-15 02:01:17,684 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/0b43ec896aa142f2904bd41f012fef19, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,685 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f2/5c4e8614fbd0449496f11d3607f85756 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/5c4e8614fbd0449496f11d3607f85756 2023-02-15 02:01:17,689 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/5c4e8614fbd0449496f11d3607f85756, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:17,690 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0eb976d3b25f104b73093404f1721891 in 72ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:17,690 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:17,690 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,691 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:17,691 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/0b43ec896aa142f2904bd41f012fef19] hfiles 2023-02-15 02:01:17,691 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/0b43ec896aa142f2904bd41f012fef19 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,691 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/5c4e8614fbd0449496f11d3607f85756] hfiles 2023-02-15 02:01:17,691 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/5c4e8614fbd0449496f11d3607f85756 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,699 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. completed. 2023-02-15 02:01:17,699 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:17,699 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 02:01:17,699 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 02:01:17,699 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,699 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 02:01:17,700 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,33779,1676426474226' in zk 2023-02-15 02:01:17,701 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,701 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 02:01:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:17,701 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:17,701 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 02:01:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,33779,1676426474226': 2023-02-15 02:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33779,1676426474226' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:17,704 INFO [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-15 02:01:17,704 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:17,704 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:17,704 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,704 INFO [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:17,713 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:17,713 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:17,713 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:17,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:17,714 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,715 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:17,715 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,722 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:17,722 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:17,722 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:17,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:17,722 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:17,722 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:17,722 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:17,722 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:17,723 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,723 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,723 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:17,723 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,724 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:17,724 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,724 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:17,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:17,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:17,782 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:17,949 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:17,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:17,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:17,955 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 02:01:18,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-15 02:01:18,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:18,357 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:18,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676426477303Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676426477722 (+419 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676426477724 (+2 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676426477736 (+12 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676426477748 (+12 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676426478357 (+609 ms) 2023-02-15 02:01:18,359 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:18,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0550 sec 2023-02-15 02:01:18,455 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:18,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:18,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:18,457 INFO [Listener at localhost.localdomain/34749] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:18,462 INFO [Listener at localhost.localdomain/34749] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:18,471 INFO [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:18,509 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34777] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:18,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33779] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:18,599 INFO [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:18,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:18,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 02:01:18,610 INFO [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 02:01:18,610 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:18,611 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 02:01:18,611 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 02:01:18,612 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,612 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,613 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,613 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:18,613 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:18,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:18,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:18,613 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,613 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,614 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 02:01:18,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 02:01:18,619 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 02:01:18,619 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:18,619 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 02:01:18,620 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 02:01:18,620 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:18,621 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 02:01:18,621 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:18,621 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. started... 2023-02-15 02:01:18,621 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:18,621 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:18,621 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:18,621 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. started... 2023-02-15 02:01:18,621 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5d1d47ae698ddd33c3ee1f8a6d28901c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:18,625 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:18,625 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. started... 2023-02-15 02:01:18,625 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:18,625 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. started... 2023-02-15 02:01:18,625 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f655a63d1336202d5820ee1e42709a34 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:18,625 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9acb08c021afed1a4929a62c0a92ce6e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:18,627 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 02:01:18,631 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:18,631 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:18,631 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 02:01:18,631 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:18,631 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 02:01:18,631 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. started... 2023-02-15 02:01:18,631 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8829ca9f56c3e37040e5191b1aec1ac4 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. started... 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. started... 2023-02-15 02:01:18,636 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:18,636 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. started... 2023-02-15 02:01:18,636 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b646a8e95a92ebc86853666a8adb2488 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:18,636 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing abff50fd1e71f3c8338ef0ccde1ee1ae 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 02:01:18,685 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f1/d7c666d4092744928529c598b76e18c7 2023-02-15 02:01:18,703 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f1/b3c4c606c37e45359298ec32847bdf4f 2023-02-15 02:01:18,711 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f1/ec203408b8a3443ea23c312c521bbe8d 2023-02-15 02:01:18,712 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f1/91ef5646fafd4eb987eca844981de987 2023-02-15 02:01:18,713 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f1/c9a591d18716410f97347e618b8728b0 2023-02-15 02:01:18,734 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f1/d93b5b4a4add49ceb5586c9e49af6edb 2023-02-15 02:01:18,742 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f2/edc0d309683a4100afe0c32aac4c24a8 2023-02-15 02:01:18,746 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f2/7f0d7ac0248542cc85854a648359a598 2023-02-15 02:01:18,754 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f1/d7c666d4092744928529c598b76e18c7 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/d7c666d4092744928529c598b76e18c7 2023-02-15 02:01:18,755 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f1/b3c4c606c37e45359298ec32847bdf4f as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/b3c4c606c37e45359298ec32847bdf4f 2023-02-15 02:01:18,759 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f2/468820aeda4e4a8d9da186003462a2e8 2023-02-15 02:01:18,760 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f2/3266e28d04c74fd5b4e768c67606b511 2023-02-15 02:01:18,764 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/d7c666d4092744928529c598b76e18c7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,764 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/b3c4c606c37e45359298ec32847bdf4f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:18,765 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/.tmp/f2/edc0d309683a4100afe0c32aac4c24a8 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/edc0d309683a4100afe0c32aac4c24a8 2023-02-15 02:01:18,765 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/.tmp/f2/7f0d7ac0248542cc85854a648359a598 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/7f0d7ac0248542cc85854a648359a598 2023-02-15 02:01:18,768 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f1/91ef5646fafd4eb987eca844981de987 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/91ef5646fafd4eb987eca844981de987 2023-02-15 02:01:18,769 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f1/c9a591d18716410f97347e618b8728b0 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/c9a591d18716410f97347e618b8728b0 2023-02-15 02:01:18,774 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/edc0d309683a4100afe0c32aac4c24a8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:18,775 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8829ca9f56c3e37040e5191b1aec1ac4 in 144ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,776 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:18,776 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:18,776 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:18,776 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. started... 2023-02-15 02:01:18,776 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5da70eeadd1ceada3da57917e922df48 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:18,777 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/91ef5646fafd4eb987eca844981de987, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,776 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/7f0d7ac0248542cc85854a648359a598, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,776 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 02:01:18,780 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f2/99e3699bbc9042ea95bf8942e688c20f 2023-02-15 02:01:18,780 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/.tmp/f2/468820aeda4e4a8d9da186003462a2e8 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/468820aeda4e4a8d9da186003462a2e8 2023-02-15 02:01:18,781 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b646a8e95a92ebc86853666a8adb2488 in 145ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,781 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:18,781 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:18,782 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 02:01:18,782 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/c9a591d18716410f97347e618b8728b0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:18,784 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/.tmp/f2/3266e28d04c74fd5b4e768c67606b511 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/3266e28d04c74fd5b4e768c67606b511 2023-02-15 02:01:18,787 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f2/c1a1ba99e1484046b73b8dbede095bce 2023-02-15 02:01:18,791 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f1/ec203408b8a3443ea23c312c521bbe8d as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/ec203408b8a3443ea23c312c521bbe8d 2023-02-15 02:01:18,792 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/468820aeda4e4a8d9da186003462a2e8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,793 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9acb08c021afed1a4929a62c0a92ce6e in 168ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,794 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:18,794 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:18,794 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:18,794 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 02:01:18,794 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. started... 2023-02-15 02:01:18,794 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0eb976d3b25f104b73093404f1721891 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:18,795 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/3266e28d04c74fd5b4e768c67606b511, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:18,797 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for abff50fd1e71f3c8338ef0ccde1ee1ae in 161ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,798 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:18,798 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:18,798 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 02:01:18,807 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/ec203408b8a3443ea23c312c521bbe8d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,809 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f1/d93b5b4a4add49ceb5586c9e49af6edb as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/d93b5b4a4add49ceb5586c9e49af6edb 2023-02-15 02:01:18,809 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/.tmp/f2/99e3699bbc9042ea95bf8942e688c20f as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/99e3699bbc9042ea95bf8942e688c20f 2023-02-15 02:01:18,811 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f1/ed545aa5b64045898df95f48824ca1dd 2023-02-15 02:01:18,816 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/d93b5b4a4add49ceb5586c9e49af6edb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,817 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/99e3699bbc9042ea95bf8942e688c20f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,817 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/.tmp/f2/c1a1ba99e1484046b73b8dbede095bce as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/c1a1ba99e1484046b73b8dbede095bce 2023-02-15 02:01:18,818 INFO [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f655a63d1336202d5820ee1e42709a34 in 193ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,818 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:18,818 DEBUG [rs(jenkins-hbase20.apache.org,34777,1676426474266)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:18,818 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 02:01:18,818 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 02:01:18,818 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,819 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 02:01:18,819 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34777,1676426474266' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 02:01:18,820 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,820 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:18,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:18,820 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,820 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:18,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34777,1676426474266' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 02:01:18,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7742754[Count = 1] remaining members to acquire global barrier 2023-02-15 02:01:18,824 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/c1a1ba99e1484046b73b8dbede095bce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,824 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5d1d47ae698ddd33c3ee1f8a6d28901c in 203ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,825 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:18,825 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:18,825 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 02:01:18,834 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f1/9d81983d59ca4609866ae054ba0ea64c 2023-02-15 02:01:18,851 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f2/466276a361f749b18a211e70642f6d8b 2023-02-15 02:01:18,858 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f1/ed545aa5b64045898df95f48824ca1dd as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/ed545aa5b64045898df95f48824ca1dd 2023-02-15 02:01:18,864 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/ed545aa5b64045898df95f48824ca1dd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,865 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/.tmp/f2/466276a361f749b18a211e70642f6d8b as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/466276a361f749b18a211e70642f6d8b 2023-02-15 02:01:18,873 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/466276a361f749b18a211e70642f6d8b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,874 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5da70eeadd1ceada3da57917e922df48 in 98ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,874 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:18,875 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:18,875 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 02:01:18,877 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f2/0761e84824234d109c88ad5a929dc592 2023-02-15 02:01:18,884 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f1/9d81983d59ca4609866ae054ba0ea64c as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/9d81983d59ca4609866ae054ba0ea64c 2023-02-15 02:01:18,889 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/9d81983d59ca4609866ae054ba0ea64c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,890 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/.tmp/f2/0761e84824234d109c88ad5a929dc592 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/0761e84824234d109c88ad5a929dc592 2023-02-15 02:01:18,896 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/0761e84824234d109c88ad5a929dc592, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:18,897 INFO [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0eb976d3b25f104b73093404f1721891 in 103ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:18,897 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:18,897 DEBUG [rs(jenkins-hbase20.apache.org,33779,1676426474226)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:18,897 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 02:01:18,897 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 02:01:18,897 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,897 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 02:01:18,897 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33779,1676426474226' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 02:01:18,898 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,898 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:18,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:18,899 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,899 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:18,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:18,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:18,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:18,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33779,1676426474226' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 02:01:18,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7742754[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:18,900 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 02:01:18,900 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,901 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 02:01:18,901 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 02:01:18,901 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 02:01:18,901 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 02:01:18,901 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,902 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,33779,1676426474226' in zk 2023-02-15 02:01:18,902 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,34777,1676426474266' in zk 2023-02-15 02:01:18,902 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,902 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:18,903 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 02:01:18,903 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,903 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:18,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:18,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:18,903 DEBUG [member: 'jenkins-hbase20.apache.org,33779,1676426474226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 02:01:18,904 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,904 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 02:01:18,904 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:18,904 DEBUG [member: 'jenkins-hbase20.apache.org,34777,1676426474266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 02:01:18,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:18,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,33779,1676426474226': 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33779,1676426474226' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:18,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,34777,1676426474266': 2023-02-15 02:01:18,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34777,1676426474266' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 02:01:18,908 INFO [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 02:01:18,909 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:18,909 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:18,909 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 02:01:18,909 INFO [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:18,916 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,916 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,916 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:18,916 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,917 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:18,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:18,917 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:18,917 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:18,919 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:18,919 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,924 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:18,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:18,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 02:01:18,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:18,925 DEBUG [(jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:18,925 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:18,926 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:18,926 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:18,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:18,926 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:18,926 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:18,927 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:19,027 DEBUG [Listener at localhost.localdomain/34749] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:19,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33825] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:19,028 INFO [Listener at localhost.localdomain/34749] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:19,029 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03297095 to 127.0.0.1:61388 2023-02-15 02:01:19,029 DEBUG [Listener at localhost.localdomain/34749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,029 DEBUG [Listener at localhost.localdomain/34749] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:19,029 DEBUG [Listener at localhost.localdomain/34749] util.JVMClusterUtil(257): Found active master hash=1082954670, stopped=false 2023-02-15 02:01:19,029 INFO [Listener at localhost.localdomain/34749] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:19,030 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:19,030 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:19,030 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:19,030 INFO [Listener at localhost.localdomain/34749] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:19,030 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:19,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:19,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:19,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:19,031 DEBUG [Listener at localhost.localdomain/34749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04c4580b to 127.0.0.1:61388 2023-02-15 02:01:19,032 DEBUG [Listener at localhost.localdomain/34749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,032 INFO [Listener at localhost.localdomain/34749] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33779,1676426474226' ***** 2023-02-15 02:01:19,032 INFO [Listener at localhost.localdomain/34749] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:19,032 INFO [Listener at localhost.localdomain/34749] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34777,1676426474266' ***** 2023-02-15 02:01:19,032 INFO [Listener at localhost.localdomain/34749] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:19,032 INFO [RS:0;jenkins-hbase20:33779] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:19,032 INFO [RS:1;jenkins-hbase20:34777] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:19,032 INFO [RS:0;jenkins-hbase20:33779] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:19,032 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:19,032 INFO [RS:0;jenkins-hbase20:33779] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:19,032 INFO [RS:1;jenkins-hbase20:34777] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:19,033 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(3304): Received CLOSE for 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:19,033 INFO [RS:1;jenkins-hbase20:34777] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:19,033 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(3304): Received CLOSE for 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:19,033 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:19,033 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(3304): Received CLOSE for f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:19,033 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(3304): Received CLOSE for 7843bc849fe036501b316b476958dbdd 2023-02-15 02:01:19,033 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(3304): Received CLOSE for 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:19,033 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(3304): Received CLOSE for abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:19,034 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(3304): Received CLOSE for 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:19,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 696219e0e10705905a593dcaa4bd95b9, disabling compactions & flushes 2023-02-15 02:01:19,034 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(3304): Received CLOSE for 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:19,034 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(3304): Received CLOSE for a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:19,039 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(3304): Received CLOSE for 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:19,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5d1d47ae698ddd33c3ee1f8a6d28901c, disabling compactions & flushes 2023-02-15 02:01:19,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. after waiting 0 ms 2023-02-15 02:01:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,040 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:19,040 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(3304): Received CLOSE for b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:19,040 DEBUG [RS:0;jenkins-hbase20:33779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36bf1b24 to 127.0.0.1:61388 2023-02-15 02:01:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. after waiting 0 ms 2023-02-15 02:01:19,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,040 DEBUG [RS:0;jenkins-hbase20:33779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,040 INFO [RS:0;jenkins-hbase20:33779] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:19,040 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:19,040 INFO [RS:0;jenkins-hbase20:33779] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:19,041 DEBUG [RS:1;jenkins-hbase20:34777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ebe7427 to 127.0.0.1:61388 2023-02-15 02:01:19,041 INFO [RS:0;jenkins-hbase20:33779] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:19,041 DEBUG [RS:1;jenkins-hbase20:34777] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,042 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:19,043 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-15 02:01:19,043 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1479): Online Regions={696219e0e10705905a593dcaa4bd95b9=testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9., f655a63d1336202d5820ee1e42709a34=testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34., 7843bc849fe036501b316b476958dbdd=hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd., abff50fd1e71f3c8338ef0ccde1ee1ae=testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae., a8adaad31c62ab398e3e0d4c64b989a7=testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7., b646a8e95a92ebc86853666a8adb2488=testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.} 2023-02-15 02:01:19,043 DEBUG [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1505): Waiting on 696219e0e10705905a593dcaa4bd95b9, 7843bc849fe036501b316b476958dbdd, a8adaad31c62ab398e3e0d4c64b989a7, abff50fd1e71f3c8338ef0ccde1ee1ae, b646a8e95a92ebc86853666a8adb2488, f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:19,044 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-15 02:01:19,047 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1479): Online Regions={5d1d47ae698ddd33c3ee1f8a6d28901c=testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c., 9acb08c021afed1a4929a62c0a92ce6e=testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e., 8829ca9f56c3e37040e5191b1aec1ac4=testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4., 5da70eeadd1ceada3da57917e922df48=testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48., 1588230740=hbase:meta,,1.1588230740, 0eb976d3b25f104b73093404f1721891=testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.} 2023-02-15 02:01:19,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:19,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:19,047 DEBUG [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1505): Waiting on 0eb976d3b25f104b73093404f1721891, 1588230740, 5d1d47ae698ddd33c3ee1f8a6d28901c, 5da70eeadd1ceada3da57917e922df48, 8829ca9f56c3e37040e5191b1aec1ac4, 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:19,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:19,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:19,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:19,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.97 KB heapSize=23.05 KB 2023-02-15 02:01:19,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 02:01:19,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:19,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f655a63d1336202d5820ee1e42709a34, disabling compactions & flushes 2023-02-15 02:01:19,050 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:19,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,050 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:19,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. after waiting 0 ms 2023-02-15 02:01:19,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:19,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9acb08c021afed1a4929a62c0a92ce6e, disabling compactions & flushes 2023-02-15 02:01:19,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. after waiting 0 ms 2023-02-15 02:01:19,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:19,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7843bc849fe036501b316b476958dbdd, disabling compactions & flushes 2023-02-15 02:01:19,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:19,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:19,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. after waiting 0 ms 2023-02-15 02:01:19,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:19,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 7843bc849fe036501b316b476958dbdd 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:19,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.78 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/.tmp/info/b5d93482919d4969a1d06c595eceecb9 2023-02-15 02:01:19,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:19,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8829ca9f56c3e37040e5191b1aec1ac4, disabling compactions & flushes 2023-02-15 02:01:19,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. after waiting 0 ms 2023-02-15 02:01:19,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/.tmp/info/f2df9871e792409184a53e1d37200faa 2023-02-15 02:01:19,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/.tmp/table/caf022752d454975a53f1212810e818d 2023-02-15 02:01:19,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:19,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5da70eeadd1ceada3da57917e922df48, disabling compactions & flushes 2023-02-15 02:01:19,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. after waiting 0 ms 2023-02-15 02:01:19,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/.tmp/info/f2df9871e792409184a53e1d37200faa as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/info/f2df9871e792409184a53e1d37200faa 2023-02-15 02:01:19,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/.tmp/info/b5d93482919d4969a1d06c595eceecb9 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/info/b5d93482919d4969a1d06c595eceecb9 2023-02-15 02:01:19,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/info/f2df9871e792409184a53e1d37200faa, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:19,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7843bc849fe036501b316b476958dbdd in 54ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:19,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 02:01:19,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/info/b5d93482919d4969a1d06c595eceecb9, entries=110, sequenceid=32, filesize=18.7 K 2023-02-15 02:01:19,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/.tmp/table/caf022752d454975a53f1212810e818d as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/table/caf022752d454975a53f1212810e818d 2023-02-15 02:01:19,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/table/caf022752d454975a53f1212810e818d, entries=4, sequenceid=32, filesize=4.8 K 2023-02-15 02:01:19,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.97 KB/14302, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 88ms, sequenceid=32, compaction requested=false 2023-02-15 02:01:19,135 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 02:01:19,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,150 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-15 02:01:19,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/hbase/namespace/7843bc849fe036501b316b476958dbdd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0eb976d3b25f104b73093404f1721891, disabling compactions & flushes 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:19,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. after waiting 0 ms 2023-02-15 02:01:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:19,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:19,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:19,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:19,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7843bc849fe036501b316b476958dbdd: 2023-02-15 02:01:19,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426474965.7843bc849fe036501b316b476958dbdd. 2023-02-15 02:01:19,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing abff50fd1e71f3c8338ef0ccde1ee1ae, disabling compactions & flushes 2023-02-15 02:01:19,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. after waiting 0 ms 2023-02-15 02:01:19,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:19,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing a8adaad31c62ab398e3e0d4c64b989a7, disabling compactions & flushes 2023-02-15 02:01:19,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. after waiting 0 ms 2023-02-15 02:01:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 02:01:19,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b646a8e95a92ebc86853666a8adb2488, disabling compactions & flushes 2023-02-15 02:01:19,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. after waiting 0 ms 2023-02-15 02:01:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:19,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:19,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,243 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34777,1676426474266; all regions closed. 2023-02-15 02:01:19,247 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33779,1676426474226; all regions closed. 2023-02-15 02:01:19,249 DEBUG [RS:1;jenkins-hbase20:34777] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/oldWALs 2023-02-15 02:01:19,250 INFO [RS:1;jenkins-hbase20:34777] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34777%2C1676426474266:(num 1676426475610) 2023-02-15 02:01:19,250 DEBUG [RS:1;jenkins-hbase20:34777] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,250 INFO [RS:1;jenkins-hbase20:34777] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:19,250 INFO [RS:1;jenkins-hbase20:34777] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:19,251 INFO [RS:1;jenkins-hbase20:34777] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:19,251 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:19,251 INFO [RS:1;jenkins-hbase20:34777] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:19,251 INFO [RS:1;jenkins-hbase20:34777] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:19,252 INFO [RS:1;jenkins-hbase20:34777] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34777 2023-02-15 02:01:19,255 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:19,255 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34777,1676426474266 2023-02-15 02:01:19,255 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:19,255 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:19,255 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:19,255 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cb8bdcd rejected from java.util.concurrent.ThreadPoolExecutor@38873e82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,255 DEBUG [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/oldWALs 2023-02-15 02:01:19,255 INFO [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33779%2C1676426474226.meta:.meta(num 1676426474897) 2023-02-15 02:01:19,255 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34777,1676426474266] 2023-02-15 02:01:19,255 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34777,1676426474266; numProcessing=1 2023-02-15 02:01:19,256 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34777,1676426474266 already deleted, retry=false 2023-02-15 02:01:19,256 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34777,1676426474266 expired; onlineServers=1 2023-02-15 02:01:19,260 DEBUG [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/oldWALs 2023-02-15 02:01:19,260 INFO [RS:0;jenkins-hbase20:33779] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33779%2C1676426474226:(num 1676426475615) 2023-02-15 02:01:19,260 DEBUG [RS:0;jenkins-hbase20:33779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,260 INFO [RS:0;jenkins-hbase20:33779] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:19,260 INFO [RS:0;jenkins-hbase20:33779] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:19,260 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:19,261 INFO [RS:0;jenkins-hbase20:33779] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33779 2023-02-15 02:01:19,271 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:19,271 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33779,1676426474226 2023-02-15 02:01:19,271 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7618ca81 rejected from java.util.concurrent.ThreadPoolExecutor@7227409a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,274 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33779,1676426474226] 2023-02-15 02:01:19,274 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33779,1676426474226; numProcessing=2 2023-02-15 02:01:19,275 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33779,1676426474226 already deleted, retry=false 2023-02-15 02:01:19,275 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33779,1676426474226 expired; onlineServers=0 2023-02-15 02:01:19,275 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33825,1676426474158' ***** 2023-02-15 02:01:19,275 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:19,276 DEBUG [M:0;jenkins-hbase20:33825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b19995, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:19,277 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33825,1676426474158 2023-02-15 02:01:19,277 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33825,1676426474158; all regions closed. 2023-02-15 02:01:19,277 DEBUG [M:0;jenkins-hbase20:33825] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:19,277 DEBUG [M:0;jenkins-hbase20:33825] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:19,277 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:19,277 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426474483] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426474483,5,FailOnTimeoutGroup] 2023-02-15 02:01:19,277 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:19,277 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426474483] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426474483,5,FailOnTimeoutGroup] 2023-02-15 02:01:19,277 DEBUG [M:0;jenkins-hbase20:33825] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:19,278 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:19,279 INFO [M:0;jenkins-hbase20:33825] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:19,279 INFO [M:0;jenkins-hbase20:33825] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:19,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:19,279 INFO [M:0;jenkins-hbase20:33825] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:19,279 DEBUG [M:0;jenkins-hbase20:33825] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:19,279 INFO [M:0;jenkins-hbase20:33825] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:19,279 ERROR [M:0;jenkins-hbase20:33825] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 02:01:19,280 INFO [M:0;jenkins-hbase20:33825] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:19,280 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:19,280 DEBUG [M:0;jenkins-hbase20:33825] zookeeper.ZKUtil(398): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 02:01:19,280 WARN [M:0;jenkins-hbase20:33825] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 02:01:19,280 INFO [M:0;jenkins-hbase20:33825] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:19,280 INFO [M:0;jenkins-hbase20:33825] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:19,280 DEBUG [M:0;jenkins-hbase20:33825] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:19,280 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:19,281 DEBUG [M:0;jenkins-hbase20:33825] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:19,281 DEBUG [M:0;jenkins-hbase20:33825] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:19,281 DEBUG [M:0;jenkins-hbase20:33825] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:19,281 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=101.12 KB heapSize=120.84 KB 2023-02-15 02:01:19,290 INFO [M:0;jenkins-hbase20:33825] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=101.12 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2ec183f576784c0f9da04bb5acd206b0 2023-02-15 02:01:19,295 DEBUG [M:0;jenkins-hbase20:33825] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2ec183f576784c0f9da04bb5acd206b0 as hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2ec183f576784c0f9da04bb5acd206b0 2023-02-15 02:01:19,300 INFO [M:0;jenkins-hbase20:33825] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36269/user/jenkins/test-data/3921e49c-0d71-00c8-4f1c-a964093c6777/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2ec183f576784c0f9da04bb5acd206b0, entries=31, sequenceid=218, filesize=9.0 K 2023-02-15 02:01:19,301 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegion(2947): Finished flush of dataSize ~101.12 KB/103547, heapSize ~120.82 KB/123720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-15 02:01:19,302 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:19,302 DEBUG [M:0;jenkins-hbase20:33825] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:19,306 INFO [M:0;jenkins-hbase20:33825] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:19,306 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:19,307 INFO [M:0;jenkins-hbase20:33825] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33825 2023-02-15 02:01:19,309 DEBUG [M:0;jenkins-hbase20:33825] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,33825,1676426474158 already deleted, retry=false 2023-02-15 02:01:19,532 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:19,533 INFO [M:0;jenkins-hbase20:33825] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33825,1676426474158; zookeeper connection closed. 2023-02-15 02:01:19,533 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d5d28f6 rejected from java.util.concurrent.ThreadPoolExecutor@962ad85[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,533 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): master:33825-0x10163ddb4440000, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:19,534 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1998e8da rejected from java.util.concurrent.ThreadPoolExecutor@962ad85[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,633 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:19,633 INFO [RS:0;jenkins-hbase20:33779] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33779,1676426474226; zookeeper connection closed. 2023-02-15 02:01:19,633 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36a43dcf rejected from java.util.concurrent.ThreadPoolExecutor@7227409a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,633 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d828b05] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d828b05 2023-02-15 02:01:19,633 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:33779-0x10163ddb4440001, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:19,633 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e331699 rejected from java.util.concurrent.ThreadPoolExecutor@7227409a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,733 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:19,733 INFO [RS:1;jenkins-hbase20:34777] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34777,1676426474266; zookeeper connection closed. 2023-02-15 02:01:19,733 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@351dad71 rejected from java.util.concurrent.ThreadPoolExecutor@38873e82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,733 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f0577a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f0577a6 2023-02-15 02:01:19,734 DEBUG [Listener at localhost.localdomain/34749-EventThread] zookeeper.ZKWatcher(600): regionserver:34777-0x10163ddb4440002, quorum=127.0.0.1:61388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:19,734 ERROR [Listener at localhost.localdomain/34749-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dc06cf0 rejected from java.util.concurrent.ThreadPoolExecutor@38873e82[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:19,734 INFO [Listener at localhost.localdomain/34749] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:19,805 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop-4709735890935443114.jar 2023-02-15 02:01:19,810 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676426477290 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:19,810 DEBUG [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce 2023-02-15 02:01:19,811 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:19,811 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:19,811 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:19,811 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:19,811 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(239): region to add: b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=9acb08c021afed1a4929a62c0a92ce6e as 9acb08c021afed1a4929a62c0a92ce6e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=5d1d47ae698ddd33c3ee1f8a6d28901c as 5d1d47ae698ddd33c3ee1f8a6d28901c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=8829ca9f56c3e37040e5191b1aec1ac4 as 8829ca9f56c3e37040e5191b1aec1ac4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=5da70eeadd1ceada3da57917e922df48 as 5da70eeadd1ceada3da57917e922df48 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=696219e0e10705905a593dcaa4bd95b9 as 696219e0e10705905a593dcaa4bd95b9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,812 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=f655a63d1336202d5820ee1e42709a34 as f655a63d1336202d5820ee1e42709a34 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,813 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=abff50fd1e71f3c8338ef0ccde1ee1ae as abff50fd1e71f3c8338ef0ccde1ee1ae in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,813 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=a8adaad31c62ab398e3e0d4c64b989a7 as a8adaad31c62ab398e3e0d4c64b989a7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,813 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=0eb976d3b25f104b73093404f1721891 as 0eb976d3b25f104b73093404f1721891 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,813 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(585): clone region=b646a8e95a92ebc86853666a8adb2488 as b646a8e95a92ebc86853666a8adb2488 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 02:01:19,814 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9acb08c021afed1a4929a62c0a92ce6e, NAME => 'testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,814 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5d1d47ae698ddd33c3ee1f8a6d28901c, NAME => 'testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,815 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 696219e0e10705905a593dcaa4bd95b9, NAME => 'testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,815 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => abff50fd1e71f3c8338ef0ccde1ee1ae, NAME => 'testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,815 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => f655a63d1336202d5820ee1e42709a34, NAME => 'testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,815 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8829ca9f56c3e37040e5191b1aec1ac4, NAME => 'testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,815 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 5da70eeadd1ceada3da57917e922df48, NAME => 'testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,815 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a8adaad31c62ab398e3e0d4c64b989a7, NAME => 'testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,846 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,846 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35d66375d2fe4de3acdd615cacae8182 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,852 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,852 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98d1da3eda74403e91a2b7c8b35095ff from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,853 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f3b286eba7741a3906e3ce12e51558b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,859 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,859 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a8adaad31c62ab398e3e0d4c64b989a7, disabling compactions & flushes 2023-02-15 02:01:19,859 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,859 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,859 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. after waiting 0 ms 2023-02-15 02:01:19,859 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,859 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:19,859 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:19,860 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0eb976d3b25f104b73093404f1721891, NAME => 'testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,868 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05eaeed7210b4b4b98628f3f61130131 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,869 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2d81a9bdcf8245f4982e68180be03707 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,869 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,869 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 529ee9a3db504041a78e7238f6014fb0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,870 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9acb08c021afed1a4929a62c0a92ce6e, disabling compactions & flushes 2023-02-15 02:01:19,870 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,870 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,870 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. after waiting 0 ms 2023-02-15 02:01:19,870 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,870 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:19,870 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:19,870 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b646a8e95a92ebc86853666a8adb2488, NAME => 'testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,871 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,871 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aa173a43f34f40a2a6483cb37cadf8a2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,874 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,874 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d55813358db14c9fb5c5a22b1ffb0752 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,874 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,875 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 696219e0e10705905a593dcaa4bd95b9, disabling compactions & flushes 2023-02-15 02:01:19,875 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,875 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,875 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. after waiting 0 ms 2023-02-15 02:01:19,875 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,875 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:19,875 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:19,879 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05b56fc1a6e244bfb83d4212cf501957 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,887 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a1fce17d148b48778f03b8d74ff3a783 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,887 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,887 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing f655a63d1336202d5820ee1e42709a34, disabling compactions & flushes 2023-02-15 02:01:19,888 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b43ec896aa142f2904bd41f012fef19 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,888 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2423c72b7f4548f2a0790d5b118f185b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,888 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74f75719727342feb43429950b294c45 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,888 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,888 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,888 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. after waiting 0 ms 2023-02-15 02:01:19,888 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,888 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:19,888 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:19,890 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing abff50fd1e71f3c8338ef0ccde1ee1ae, disabling compactions & flushes 2023-02-15 02:01:19,890 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,890 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,890 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. after waiting 0 ms 2023-02-15 02:01:19,890 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,890 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:19,890 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:19,891 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8829ca9f56c3e37040e5191b1aec1ac4, disabling compactions & flushes 2023-02-15 02:01:19,891 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,891 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,891 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. after waiting 0 ms 2023-02-15 02:01:19,891 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,891 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:19,891 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:19,895 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c4e8614fbd0449496f11d3607f85756 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5d1d47ae698ddd33c3ee1f8a6d28901c, disabling compactions & flushes 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 5da70eeadd1ceada3da57917e922df48, disabling compactions & flushes 2023-02-15 02:01:19,896 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. after waiting 0 ms 2023-02-15 02:01:19,896 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. after waiting 0 ms 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,896 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:19,896 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:19,896 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:19,902 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0eb976d3b25f104b73093404f1721891, disabling compactions & flushes 2023-02-15 02:01:19,902 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,902 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,902 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. after waiting 0 ms 2023-02-15 02:01:19,902 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,902 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:19,902 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:19,904 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:19,904 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7bf8ee2079544e6ab1a1aaef9a3b0acc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,906 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6639f638f54043cdaeeea80b3cb303a7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 02:01:19,909 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b646a8e95a92ebc86853666a8adb2488, disabling compactions & flushes 2023-02-15 02:01:19,909 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,909 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,909 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. after waiting 0 ms 2023-02-15 02:01:19,909 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,909 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:19,909 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:19,909 INFO [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676426477290 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:19,910 DEBUG [Listener at localhost.localdomain/34749] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,910 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4 2023-02-15 02:01:19,910 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:19,911 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:19,911 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 02:01:19,912 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------0eb976d3b25f104b73093404f1721891/ 2023-02-15 02:01:19,912 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,912 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,913 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=0eb976d3b25f104b73093404f1721891-0b43ec896aa142f2904bd41f012fef19 2023-02-15 02:01:19,913 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,913 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=0eb976d3b25f104b73093404f1721891-5c4e8614fbd0449496f11d3607f85756 2023-02-15 02:01:19,913 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------5d1d47ae698ddd33c3ee1f8a6d28901c/ 2023-02-15 02:01:19,914 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,914 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,914 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=5d1d47ae698ddd33c3ee1f8a6d28901c-d55813358db14c9fb5c5a22b1ffb0752 2023-02-15 02:01:19,914 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,915 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=5d1d47ae698ddd33c3ee1f8a6d28901c-2423c72b7f4548f2a0790d5b118f185b 2023-02-15 02:01:19,915 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------5da70eeadd1ceada3da57917e922df48/ 2023-02-15 02:01:19,915 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,915 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,916 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=5da70eeadd1ceada3da57917e922df48-529ee9a3db504041a78e7238f6014fb0 2023-02-15 02:01:19,916 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,916 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=5da70eeadd1ceada3da57917e922df48-74f75719727342feb43429950b294c45 2023-02-15 02:01:19,916 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------696219e0e10705905a593dcaa4bd95b9/ 2023-02-15 02:01:19,916 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,917 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------8829ca9f56c3e37040e5191b1aec1ac4/ 2023-02-15 02:01:19,917 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,917 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,917 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=8829ca9f56c3e37040e5191b1aec1ac4-aa173a43f34f40a2a6483cb37cadf8a2 2023-02-15 02:01:19,917 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,918 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=8829ca9f56c3e37040e5191b1aec1ac4-a1fce17d148b48778f03b8d74ff3a783 2023-02-15 02:01:19,918 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------9acb08c021afed1a4929a62c0a92ce6e/ 2023-02-15 02:01:19,918 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,918 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,919 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=9acb08c021afed1a4929a62c0a92ce6e-35d66375d2fe4de3acdd615cacae8182 2023-02-15 02:01:19,919 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,919 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=9acb08c021afed1a4929a62c0a92ce6e-1f3b286eba7741a3906e3ce12e51558b 2023-02-15 02:01:19,919 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------a8adaad31c62ab398e3e0d4c64b989a7/ 2023-02-15 02:01:19,920 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,920 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------abff50fd1e71f3c8338ef0ccde1ee1ae/ 2023-02-15 02:01:19,920 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,920 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,920 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=abff50fd1e71f3c8338ef0ccde1ee1ae-05eaeed7210b4b4b98628f3f61130131 2023-02-15 02:01:19,920 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,921 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=abff50fd1e71f3c8338ef0ccde1ee1ae-05b56fc1a6e244bfb83d4212cf501957 2023-02-15 02:01:19,921 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------b646a8e95a92ebc86853666a8adb2488/ 2023-02-15 02:01:19,921 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,921 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,921 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=b646a8e95a92ebc86853666a8adb2488-7bf8ee2079544e6ab1a1aaef9a3b0acc 2023-02-15 02:01:19,922 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,922 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=b646a8e95a92ebc86853666a8adb2488-6639f638f54043cdaeeea80b3cb303a7 2023-02-15 02:01:19,922 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |----------f655a63d1336202d5820ee1e42709a34/ 2023-02-15 02:01:19,922 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:19,922 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:19,923 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=f655a63d1336202d5820ee1e42709a34-98d1da3eda74403e91a2b7c8b35095ff 2023-02-15 02:01:19,923 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:19,923 DEBUG [Listener at localhost.localdomain/34749] util.CommonFSUtils(702): |----------------testWithMapReduce=f655a63d1336202d5820ee1e42709a34-2d81a9bdcf8245f4982e68180be03707 2023-02-15 02:01:19,923 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:19,924 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:19,924 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:19,924 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,671 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop-946625248074483550.jar 2023-02-15 02:01:20,672 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,672 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,737 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop-5249108295321764939.jar 2023-02-15 02:01:20,737 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,738 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,738 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,738 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,739 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,739 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,739 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 02:01:20,740 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 02:01:20,740 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 02:01:20,740 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 02:01:20,741 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 02:01:20,741 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 02:01:20,741 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 02:01:20,742 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 02:01:20,742 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 02:01:20,742 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 02:01:20,743 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:20,743 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:20,743 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:20,744 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:20,744 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 02:01:20,797 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop-4261497831737762731.jar 2023-02-15 02:01:20,798 DEBUG [Listener at localhost.localdomain/34749] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 02:01:20,802 WARN [Listener at localhost.localdomain/34749] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 02:01:20,807 WARN [Listener at localhost.localdomain/34749] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-15 02:01:20,813 INFO [Listener at localhost.localdomain/34749] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 02:01:20,906 WARN [Listener at localhost.localdomain/34749] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/mapreduce.cluster.local.dir/1676426480880/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 02:01:20,906 WARN [Listener at localhost.localdomain/34749] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/mapreduce.cluster.local.dir/1676426480880/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 02:01:20,936 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:20,936 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:20,937 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:20,939 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:20,941 DEBUG [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/f1 2023-02-15 02:01:20,941 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 696219e0e10705905a593dcaa4bd95b9 columnFamilyName f1 2023-02-15 02:01:20,942 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(310): Store=696219e0e10705905a593dcaa4bd95b9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:20,942 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 696219e0e10705905a593dcaa4bd95b9 2023-02-15 02:01:20,944 DEBUG [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/696219e0e10705905a593dcaa4bd95b9/f2 2023-02-15 02:01:20,944 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 696219e0e10705905a593dcaa4bd95b9 columnFamilyName f2 2023-02-15 02:01:20,945 INFO [StoreOpener-696219e0e10705905a593dcaa4bd95b9-1] regionserver.HStore(310): Store=696219e0e10705905a593dcaa4bd95b9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:20,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:20,945 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 696219e0e10705905a593dcaa4bd95b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70992444, jitterRate=0.05786985158920288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:20,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:20,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 696219e0e10705905a593dcaa4bd95b9, disabling compactions & flushes 2023-02-15 02:01:20,953 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:20,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:20,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. after waiting 0 ms 2023-02-15 02:01:20,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:20,953 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426475907.696219e0e10705905a593dcaa4bd95b9. 2023-02-15 02:01:20,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 696219e0e10705905a593dcaa4bd95b9: 2023-02-15 02:01:20,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:20,956 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:20,957 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:20,959 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:20,960 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1 2023-02-15 02:01:20,961 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eb976d3b25f104b73093404f1721891 columnFamilyName f1 2023-02-15 02:01:20,965 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f1/testWithMapReduce=0eb976d3b25f104b73093404f1721891-0b43ec896aa142f2904bd41f012fef19 2023-02-15 02:01:20,966 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(310): Store=0eb976d3b25f104b73093404f1721891/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:20,966 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0eb976d3b25f104b73093404f1721891 2023-02-15 02:01:20,967 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2 2023-02-15 02:01:20,967 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eb976d3b25f104b73093404f1721891 columnFamilyName f2 2023-02-15 02:01:20,971 DEBUG [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/0eb976d3b25f104b73093404f1721891/f2/testWithMapReduce=0eb976d3b25f104b73093404f1721891-5c4e8614fbd0449496f11d3607f85756 2023-02-15 02:01:20,971 INFO [StoreOpener-0eb976d3b25f104b73093404f1721891-1] regionserver.HStore(310): Store=0eb976d3b25f104b73093404f1721891/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:20,971 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:20,972 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0eb976d3b25f104b73093404f1721891; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74147748, jitterRate=0.10488754510879517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:20,972 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:20,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0eb976d3b25f104b73093404f1721891, disabling compactions & flushes 2023-02-15 02:01:20,996 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:20,996 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:20,996 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. after waiting 0 ms 2023-02-15 02:01:20,996 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:20,997 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676426475907.0eb976d3b25f104b73093404f1721891. 2023-02-15 02:01:20,997 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0eb976d3b25f104b73093404f1721891: 2023-02-15 02:01:21,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,001 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,003 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,007 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:21,008 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1 2023-02-15 02:01:21,008 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9acb08c021afed1a4929a62c0a92ce6e columnFamilyName f1 2023-02-15 02:01:21,013 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f1/testWithMapReduce=9acb08c021afed1a4929a62c0a92ce6e-35d66375d2fe4de3acdd615cacae8182 2023-02-15 02:01:21,013 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(310): Store=9acb08c021afed1a4929a62c0a92ce6e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,013 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9acb08c021afed1a4929a62c0a92ce6e 2023-02-15 02:01:21,014 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2 2023-02-15 02:01:21,015 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9acb08c021afed1a4929a62c0a92ce6e columnFamilyName f2 2023-02-15 02:01:21,021 DEBUG [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/9acb08c021afed1a4929a62c0a92ce6e/f2/testWithMapReduce=9acb08c021afed1a4929a62c0a92ce6e-1f3b286eba7741a3906e3ce12e51558b 2023-02-15 02:01:21,021 INFO [StoreOpener-9acb08c021afed1a4929a62c0a92ce6e-1] regionserver.HStore(310): Store=9acb08c021afed1a4929a62c0a92ce6e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,022 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9acb08c021afed1a4929a62c0a92ce6e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68110060, jitterRate=0.014918982982635498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:21,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9acb08c021afed1a4929a62c0a92ce6e, disabling compactions & flushes 2023-02-15 02:01:21,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:21,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:21,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. after waiting 0 ms 2023-02-15 02:01:21,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:21,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676426475907.9acb08c021afed1a4929a62c0a92ce6e. 2023-02-15 02:01:21,058 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9acb08c021afed1a4929a62c0a92ce6e: 2023-02-15 02:01:21,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,061 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,064 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,066 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:21,067 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1 2023-02-15 02:01:21,067 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d1d47ae698ddd33c3ee1f8a6d28901c columnFamilyName f1 2023-02-15 02:01:21,072 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f1/testWithMapReduce=5d1d47ae698ddd33c3ee1f8a6d28901c-d55813358db14c9fb5c5a22b1ffb0752 2023-02-15 02:01:21,072 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(310): Store=5d1d47ae698ddd33c3ee1f8a6d28901c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,072 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5d1d47ae698ddd33c3ee1f8a6d28901c 2023-02-15 02:01:21,073 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2 2023-02-15 02:01:21,074 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d1d47ae698ddd33c3ee1f8a6d28901c columnFamilyName f2 2023-02-15 02:01:21,078 DEBUG [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5d1d47ae698ddd33c3ee1f8a6d28901c/f2/testWithMapReduce=5d1d47ae698ddd33c3ee1f8a6d28901c-2423c72b7f4548f2a0790d5b118f185b 2023-02-15 02:01:21,079 INFO [StoreOpener-5d1d47ae698ddd33c3ee1f8a6d28901c-1] regionserver.HStore(310): Store=5d1d47ae698ddd33c3ee1f8a6d28901c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,079 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5d1d47ae698ddd33c3ee1f8a6d28901c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71954271, jitterRate=0.07220219075679779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:21,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5d1d47ae698ddd33c3ee1f8a6d28901c, disabling compactions & flushes 2023-02-15 02:01:21,097 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:21,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:21,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. after waiting 0 ms 2023-02-15 02:01:21,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:21,098 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676426475907.5d1d47ae698ddd33c3ee1f8a6d28901c. 2023-02-15 02:01:21,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5d1d47ae698ddd33c3ee1f8a6d28901c: 2023-02-15 02:01:21,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,101 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,102 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,104 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:21,105 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1 2023-02-15 02:01:21,106 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5da70eeadd1ceada3da57917e922df48 columnFamilyName f1 2023-02-15 02:01:21,111 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f1/testWithMapReduce=5da70eeadd1ceada3da57917e922df48-529ee9a3db504041a78e7238f6014fb0 2023-02-15 02:01:21,111 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(310): Store=5da70eeadd1ceada3da57917e922df48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,111 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5da70eeadd1ceada3da57917e922df48 2023-02-15 02:01:21,112 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2 2023-02-15 02:01:21,113 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5da70eeadd1ceada3da57917e922df48 columnFamilyName f2 2023-02-15 02:01:21,117 DEBUG [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/5da70eeadd1ceada3da57917e922df48/f2/testWithMapReduce=5da70eeadd1ceada3da57917e922df48-74f75719727342feb43429950b294c45 2023-02-15 02:01:21,118 INFO [StoreOpener-5da70eeadd1ceada3da57917e922df48-1] regionserver.HStore(310): Store=5da70eeadd1ceada3da57917e922df48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,118 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5da70eeadd1ceada3da57917e922df48; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59177798, jitterRate=-0.11818209290504456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:21,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5da70eeadd1ceada3da57917e922df48, disabling compactions & flushes 2023-02-15 02:01:21,135 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:21,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:21,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. after waiting 0 ms 2023-02-15 02:01:21,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:21,136 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676426475907.5da70eeadd1ceada3da57917e922df48. 2023-02-15 02:01:21,136 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5da70eeadd1ceada3da57917e922df48: 2023-02-15 02:01:21,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,140 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,142 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,143 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:21,144 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1 2023-02-15 02:01:21,145 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abff50fd1e71f3c8338ef0ccde1ee1ae columnFamilyName f1 2023-02-15 02:01:21,149 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f1/testWithMapReduce=abff50fd1e71f3c8338ef0ccde1ee1ae-05eaeed7210b4b4b98628f3f61130131 2023-02-15 02:01:21,149 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(310): Store=abff50fd1e71f3c8338ef0ccde1ee1ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,150 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region abff50fd1e71f3c8338ef0ccde1ee1ae 2023-02-15 02:01:21,151 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2 2023-02-15 02:01:21,151 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abff50fd1e71f3c8338ef0ccde1ee1ae columnFamilyName f2 2023-02-15 02:01:21,155 DEBUG [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/abff50fd1e71f3c8338ef0ccde1ee1ae/f2/testWithMapReduce=abff50fd1e71f3c8338ef0ccde1ee1ae-05b56fc1a6e244bfb83d4212cf501957 2023-02-15 02:01:21,156 INFO [StoreOpener-abff50fd1e71f3c8338ef0ccde1ee1ae-1] regionserver.HStore(310): Store=abff50fd1e71f3c8338ef0ccde1ee1ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,156 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,156 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened abff50fd1e71f3c8338ef0ccde1ee1ae; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70218387, jitterRate=0.046335503458976746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,156 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:21,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing abff50fd1e71f3c8338ef0ccde1ee1ae, disabling compactions & flushes 2023-02-15 02:01:21,185 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:21,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:21,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. after waiting 0 ms 2023-02-15 02:01:21,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:21,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676426475907.abff50fd1e71f3c8338ef0ccde1ee1ae. 2023-02-15 02:01:21,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for abff50fd1e71f3c8338ef0ccde1ee1ae: 2023-02-15 02:01:21,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,189 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,190 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,193 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:21,194 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1 2023-02-15 02:01:21,194 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b646a8e95a92ebc86853666a8adb2488 columnFamilyName f1 2023-02-15 02:01:21,200 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f1/testWithMapReduce=b646a8e95a92ebc86853666a8adb2488-7bf8ee2079544e6ab1a1aaef9a3b0acc 2023-02-15 02:01:21,200 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(310): Store=b646a8e95a92ebc86853666a8adb2488/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,200 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b646a8e95a92ebc86853666a8adb2488 2023-02-15 02:01:21,201 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2 2023-02-15 02:01:21,202 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b646a8e95a92ebc86853666a8adb2488 columnFamilyName f2 2023-02-15 02:01:21,208 DEBUG [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/b646a8e95a92ebc86853666a8adb2488/f2/testWithMapReduce=b646a8e95a92ebc86853666a8adb2488-6639f638f54043cdaeeea80b3cb303a7 2023-02-15 02:01:21,208 INFO [StoreOpener-b646a8e95a92ebc86853666a8adb2488-1] regionserver.HStore(310): Store=b646a8e95a92ebc86853666a8adb2488/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,208 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b646a8e95a92ebc86853666a8adb2488; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59705085, jitterRate=-0.1103249043226242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:21,246 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b646a8e95a92ebc86853666a8adb2488, disabling compactions & flushes 2023-02-15 02:01:21,247 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:21,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:21,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. after waiting 0 ms 2023-02-15 02:01:21,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:21,247 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676426475907.b646a8e95a92ebc86853666a8adb2488. 2023-02-15 02:01:21,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b646a8e95a92ebc86853666a8adb2488: 2023-02-15 02:01:21,251 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,251 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,253 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,255 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:21,256 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1 2023-02-15 02:01:21,256 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f655a63d1336202d5820ee1e42709a34 columnFamilyName f1 2023-02-15 02:01:21,262 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f1/testWithMapReduce=f655a63d1336202d5820ee1e42709a34-98d1da3eda74403e91a2b7c8b35095ff 2023-02-15 02:01:21,262 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(310): Store=f655a63d1336202d5820ee1e42709a34/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,262 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f655a63d1336202d5820ee1e42709a34 2023-02-15 02:01:21,263 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2 2023-02-15 02:01:21,264 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f655a63d1336202d5820ee1e42709a34 columnFamilyName f2 2023-02-15 02:01:21,269 DEBUG [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/f655a63d1336202d5820ee1e42709a34/f2/testWithMapReduce=f655a63d1336202d5820ee1e42709a34-2d81a9bdcf8245f4982e68180be03707 2023-02-15 02:01:21,270 INFO [StoreOpener-f655a63d1336202d5820ee1e42709a34-1] regionserver.HStore(310): Store=f655a63d1336202d5820ee1e42709a34/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,270 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f655a63d1336202d5820ee1e42709a34; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66621856, jitterRate=-0.007256984710693359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:21,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f655a63d1336202d5820ee1e42709a34, disabling compactions & flushes 2023-02-15 02:01:21,289 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:21,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:21,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. after waiting 0 ms 2023-02-15 02:01:21,289 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:21,290 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676426475907.f655a63d1336202d5820ee1e42709a34. 2023-02-15 02:01:21,290 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f655a63d1336202d5820ee1e42709a34: 2023-02-15 02:01:21,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,293 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,295 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,298 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:21,299 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1 2023-02-15 02:01:21,300 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8829ca9f56c3e37040e5191b1aec1ac4 columnFamilyName f1 2023-02-15 02:01:21,305 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f1/testWithMapReduce=8829ca9f56c3e37040e5191b1aec1ac4-aa173a43f34f40a2a6483cb37cadf8a2 2023-02-15 02:01:21,305 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(310): Store=8829ca9f56c3e37040e5191b1aec1ac4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,305 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8829ca9f56c3e37040e5191b1aec1ac4 2023-02-15 02:01:21,306 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2 2023-02-15 02:01:21,306 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8829ca9f56c3e37040e5191b1aec1ac4 columnFamilyName f2 2023-02-15 02:01:21,311 DEBUG [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/8829ca9f56c3e37040e5191b1aec1ac4/f2/testWithMapReduce=8829ca9f56c3e37040e5191b1aec1ac4-a1fce17d148b48778f03b8d74ff3a783 2023-02-15 02:01:21,311 INFO [StoreOpener-8829ca9f56c3e37040e5191b1aec1ac4-1] regionserver.HStore(310): Store=8829ca9f56c3e37040e5191b1aec1ac4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,311 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8829ca9f56c3e37040e5191b1aec1ac4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60643100, jitterRate=-0.0963473916053772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:21,329 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8829ca9f56c3e37040e5191b1aec1ac4, disabling compactions & flushes 2023-02-15 02:01:21,329 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:21,329 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:21,329 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. after waiting 0 ms 2023-02-15 02:01:21,329 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:21,330 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676426475907.8829ca9f56c3e37040e5191b1aec1ac4. 2023-02-15 02:01:21,330 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8829ca9f56c3e37040e5191b1aec1ac4: 2023-02-15 02:01:21,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:21,332 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:21,334 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:21,337 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:21,338 DEBUG [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/f1 2023-02-15 02:01:21,339 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8adaad31c62ab398e3e0d4c64b989a7 columnFamilyName f1 2023-02-15 02:01:21,339 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(310): Store=a8adaad31c62ab398e3e0d4c64b989a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,339 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a8adaad31c62ab398e3e0d4c64b989a7 2023-02-15 02:01:21,340 DEBUG [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36269/user/jenkins/test-data/e78808f5-a1fb-f7e0-6308-3f8a302ff2de/testWithMapReduceAndOfflineHBaseMultiRegion/38a1750e-7849-46af-a37d-529488c496f4/data/default/testWithMapReduce/a8adaad31c62ab398e3e0d4c64b989a7/f2 2023-02-15 02:01:21,340 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8adaad31c62ab398e3e0d4c64b989a7 columnFamilyName f2 2023-02-15 02:01:21,341 INFO [StoreOpener-a8adaad31c62ab398e3e0d4c64b989a7-1] regionserver.HStore(310): Store=a8adaad31c62ab398e3e0d4c64b989a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:21,341 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:21,341 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a8adaad31c62ab398e3e0d4c64b989a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73957748, jitterRate=0.10205632448196411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:21,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:21,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a8adaad31c62ab398e3e0d4c64b989a7, disabling compactions & flushes 2023-02-15 02:01:21,350 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:21,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:21,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. after waiting 0 ms 2023-02-15 02:01:21,350 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:21,351 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676426475907.a8adaad31c62ab398e3e0d4c64b989a7. 2023-02-15 02:01:21,351 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a8adaad31c62ab398e3e0d4c64b989a7: 2023-02-15 02:01:21,938 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:21,938 WARN [Listener at localhost.localdomain/34749] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:21,946 INFO [Listener at localhost.localdomain/34749] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:22,049 WARN [BP-810459108-148.251.75.209-1676426473611 heartbeating to localhost.localdomain/127.0.0.1:36269] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:22,050 WARN [BP-810459108-148.251.75.209-1676426473611 heartbeating to localhost.localdomain/127.0.0.1:36269] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-810459108-148.251.75.209-1676426473611 (Datanode Uuid ce09bf3c-1d08-4cf3-8486-dbbb1931fd6c) service to localhost.localdomain/127.0.0.1:36269 2023-02-15 02:01:22,050 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/dfs/data/data3/current/BP-810459108-148.251.75.209-1676426473611] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:22,050 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/dfs/data/data4/current/BP-810459108-148.251.75.209-1676426473611] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:22,053 WARN [Listener at localhost.localdomain/34749] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:22,060 INFO [Listener at localhost.localdomain/34749] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:22,164 WARN [BP-810459108-148.251.75.209-1676426473611 heartbeating to localhost.localdomain/127.0.0.1:36269] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:22,164 WARN [BP-810459108-148.251.75.209-1676426473611 heartbeating to localhost.localdomain/127.0.0.1:36269] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-810459108-148.251.75.209-1676426473611 (Datanode Uuid 06a7d9c6-7649-4193-a0f3-782c1af57959) service to localhost.localdomain/127.0.0.1:36269 2023-02-15 02:01:22,165 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/dfs/data/data1/current/BP-810459108-148.251.75.209-1676426473611] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:22,165 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/cluster_55265b71-fd84-eaec-4372-8f7c330236c5/dfs/data/data2/current/BP-810459108-148.251.75.209-1676426473611] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:22,174 INFO [Listener at localhost.localdomain/34749] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:22,291 INFO [Listener at localhost.localdomain/34749] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:22,342 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:22,354 INFO [Listener at localhost.localdomain/34749] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=159 (was 102) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost.localdomain/34749 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36269 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:36269 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:36269 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36269 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase20.apache.org,33825,1676426474158)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost.localdomain:36269 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36269 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36269 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=536 (was 538), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 349), ProcessCount=165 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=5741 (was 6010) 2023-02-15 02:01:22,363 INFO [Listener at localhost.localdomain/34749] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=159, OpenFileDescriptor=536, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=165, AvailableMemoryMB=5741 2023-02-15 02:01:22,372 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop.log.dir so I do NOT create it in target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba 2023-02-15 02:01:22,372 WARN [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 02:01:22,372 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop.tmp.dir so I do NOT create it in target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba 2023-02-15 02:01:22,372 WARN [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/116ceeca-9cb2-2d5c-de2f-eb6f80c0ac6b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 02:01:22,372 DEBUG [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba 2023-02-15 02:01:22,372 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:01:22,372 INFO [Listener at localhost.localdomain/34749] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f, deleteOnExit=true 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/test.cache.data in system properties and HBase conf 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:01:22,373 DEBUG [Listener at localhost.localdomain/34749] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:22,373 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:01:22,374 INFO [Listener at localhost.localdomain/34749] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:01:22,377 WARN [Listener at localhost.localdomain/34749] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:22,377 WARN [Listener at localhost.localdomain/34749] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:22,403 WARN [Listener at localhost.localdomain/34749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:22,405 INFO [Listener at localhost.localdomain/34749] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:22,413 INFO [Listener at localhost.localdomain/34749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/java.io.tmpdir/Jetty_localhost_localdomain_43429_hdfs____dbaws6/webapp 2023-02-15 02:01:22,485 INFO [Listener at localhost.localdomain/34749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:43429 2023-02-15 02:01:22,488 WARN [Listener at localhost.localdomain/34749] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:22,488 WARN [Listener at localhost.localdomain/34749] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:22,539 WARN [Listener at localhost.localdomain/33627] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:22,554 WARN [Listener at localhost.localdomain/33627] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:22,556 WARN [Listener at localhost.localdomain/33627] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:22,557 INFO [Listener at localhost.localdomain/33627] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:22,563 INFO [Listener at localhost.localdomain/33627] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/java.io.tmpdir/Jetty_localhost_38717_datanode____.fmdam9/webapp 2023-02-15 02:01:22,635 INFO [Listener at localhost.localdomain/33627] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38717 2023-02-15 02:01:22,643 WARN [Listener at localhost.localdomain/39745] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:22,661 WARN [Listener at localhost.localdomain/39745] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:22,662 WARN [Listener at localhost.localdomain/39745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:22,663 INFO [Listener at localhost.localdomain/39745] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:22,667 INFO [Listener at localhost.localdomain/39745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/java.io.tmpdir/Jetty_localhost_38993_datanode____.d8hl6z/webapp 2023-02-15 02:01:22,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x91a65167cc0608b2: Processing first storage report for DS-75cea458-40f4-475d-8b5a-c7a37083ce9c from datanode d1fe27b2-f280-4676-9913-d82ee178f2fb 2023-02-15 02:01:22,735 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x91a65167cc0608b2: from storage DS-75cea458-40f4-475d-8b5a-c7a37083ce9c node DatanodeRegistration(127.0.0.1:32943, datanodeUuid=d1fe27b2-f280-4676-9913-d82ee178f2fb, infoPort=35949, infoSecurePort=0, ipcPort=39745, storageInfo=lv=-57;cid=testClusterID;nsid=888241581;c=1676426482379), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:22,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x91a65167cc0608b2: Processing first storage report for DS-406a5ba9-c771-475d-8ccc-80f4f7455157 from datanode d1fe27b2-f280-4676-9913-d82ee178f2fb 2023-02-15 02:01:22,735 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x91a65167cc0608b2: from storage DS-406a5ba9-c771-475d-8ccc-80f4f7455157 node DatanodeRegistration(127.0.0.1:32943, datanodeUuid=d1fe27b2-f280-4676-9913-d82ee178f2fb, infoPort=35949, infoSecurePort=0, ipcPort=39745, storageInfo=lv=-57;cid=testClusterID;nsid=888241581;c=1676426482379), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:22,749 INFO [Listener at localhost.localdomain/39745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38993 2023-02-15 02:01:22,757 WARN [Listener at localhost.localdomain/46729] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:22,824 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4934c2c154fec01a: Processing first storage report for DS-0198552e-462c-4c60-a5f7-20361aeabc58 from datanode f1f0ec58-b3b9-457f-a6a0-e016e6628e3e 2023-02-15 02:01:22,824 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4934c2c154fec01a: from storage DS-0198552e-462c-4c60-a5f7-20361aeabc58 node DatanodeRegistration(127.0.0.1:44911, datanodeUuid=f1f0ec58-b3b9-457f-a6a0-e016e6628e3e, infoPort=38381, infoSecurePort=0, ipcPort=46729, storageInfo=lv=-57;cid=testClusterID;nsid=888241581;c=1676426482379), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 02:01:22,824 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4934c2c154fec01a: Processing first storage report for DS-d3e29ccc-1c43-4c36-b1a6-a26f5c4e7306 from datanode f1f0ec58-b3b9-457f-a6a0-e016e6628e3e 2023-02-15 02:01:22,824 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4934c2c154fec01a: from storage DS-d3e29ccc-1c43-4c36-b1a6-a26f5c4e7306 node DatanodeRegistration(127.0.0.1:44911, datanodeUuid=f1f0ec58-b3b9-457f-a6a0-e016e6628e3e, infoPort=38381, infoSecurePort=0, ipcPort=46729, storageInfo=lv=-57;cid=testClusterID;nsid=888241581;c=1676426482379), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:22,869 DEBUG [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba 2023-02-15 02:01:22,871 INFO [Listener at localhost.localdomain/46729] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/zookeeper_0, clientPort=52277, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:01:22,871 INFO [Listener at localhost.localdomain/46729] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52277 2023-02-15 02:01:22,872 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,872 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,886 INFO [Listener at localhost.localdomain/46729] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056 with version=8 2023-02-15 02:01:22,887 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,888 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,889 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:33627/user/jenkins/test-data/2dd0be03-5a73-5145-1bad-005f2629e8c4/hbase-staging 2023-02-15 02:01:22,891 INFO [Listener at localhost.localdomain/46729] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:22,891 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,892 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,892 INFO [Listener at localhost.localdomain/46729] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:22,892 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,892 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:22,892 INFO [Listener at localhost.localdomain/46729] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:22,894 INFO [Listener at localhost.localdomain/46729] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35533 2023-02-15 02:01:22,894 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,895 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,895 INFO [Listener at localhost.localdomain/46729] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35533 connecting to ZooKeeper ensemble=127.0.0.1:52277 2023-02-15 02:01:22,904 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:355330x0, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:22,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35533-0x10163ddd6650000 connected 2023-02-15 02:01:22,922 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:22,923 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:22,923 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:22,924 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35533 2023-02-15 02:01:22,924 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35533 2023-02-15 02:01:22,924 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35533 2023-02-15 02:01:22,926 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35533 2023-02-15 02:01:22,926 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35533 2023-02-15 02:01:22,926 INFO [Listener at localhost.localdomain/46729] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056, hbase.cluster.distributed=false 2023-02-15 02:01:22,936 INFO [Listener at localhost.localdomain/46729] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:22,936 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,937 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,937 INFO [Listener at localhost.localdomain/46729] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:22,937 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,937 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:22,937 INFO [Listener at localhost.localdomain/46729] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:22,939 INFO [Listener at localhost.localdomain/46729] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35603 2023-02-15 02:01:22,939 INFO [Listener at localhost.localdomain/46729] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:22,940 DEBUG [Listener at localhost.localdomain/46729] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:22,940 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,941 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,942 INFO [Listener at localhost.localdomain/46729] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35603 connecting to ZooKeeper ensemble=127.0.0.1:52277 2023-02-15 02:01:22,944 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:356030x0, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:22,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35603-0x10163ddd6650001 connected 2023-02-15 02:01:22,946 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:22,947 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:22,947 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:22,949 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35603 2023-02-15 02:01:22,949 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35603 2023-02-15 02:01:22,950 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35603 2023-02-15 02:01:22,955 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35603 2023-02-15 02:01:22,955 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35603 2023-02-15 02:01:22,965 INFO [Listener at localhost.localdomain/46729] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:22,965 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,965 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,965 INFO [Listener at localhost.localdomain/46729] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:22,965 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:22,966 INFO [Listener at localhost.localdomain/46729] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:22,966 INFO [Listener at localhost.localdomain/46729] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:22,967 INFO [Listener at localhost.localdomain/46729] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40913 2023-02-15 02:01:22,967 INFO [Listener at localhost.localdomain/46729] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:22,971 DEBUG [Listener at localhost.localdomain/46729] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:22,971 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,972 INFO [Listener at localhost.localdomain/46729] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:22,972 INFO [Listener at localhost.localdomain/46729] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40913 connecting to ZooKeeper ensemble=127.0.0.1:52277 2023-02-15 02:01:22,975 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:409130x0, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:22,978 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): regionserver:409130x0, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:22,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40913-0x10163ddd6650002 connected 2023-02-15 02:01:22,979 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:22,980 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:22,981 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40913 2023-02-15 02:01:23,001 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40913 2023-02-15 02:01:23,002 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40913 2023-02-15 02:01:23,002 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40913 2023-02-15 02:01:23,002 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40913 2023-02-15 02:01:23,007 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,009 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:23,009 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,010 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:23,010 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:23,010 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:23,010 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,012 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:23,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:23,013 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,35533,1676426482890 from backup master directory 2023-02-15 02:01:23,014 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,014 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:23,014 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:23,014 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,029 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/hbase.id with ID: 4ac9a167-4504-4cc1-99ae-7a5a1b7a17fc 2023-02-15 02:01:23,038 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:23,040 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,050 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1d8a4058 to 127.0.0.1:52277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:23,058 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25336c16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:23,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:23,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:01:23,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:23,061 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store-tmp 2023-02-15 02:01:23,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:23,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:23,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:23,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:23,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:23,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:23,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:23,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:23,069 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/WALs/jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,071 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35533%2C1676426482890, suffix=, logDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/WALs/jenkins-hbase20.apache.org,35533,1676426482890, archiveDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/oldWALs, maxLogs=10 2023-02-15 02:01:23,086 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK] 2023-02-15 02:01:23,086 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK] 2023-02-15 02:01:23,088 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/WALs/jenkins-hbase20.apache.org,35533,1676426482890/jenkins-hbase20.apache.org%2C35533%2C1676426482890.1676426483071 2023-02-15 02:01:23,088 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK], DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK]] 2023-02-15 02:01:23,088 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:23,088 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:23,089 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:23,089 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:23,090 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:23,091 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:23,091 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:23,092 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,092 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:23,093 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:23,095 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:23,097 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:23,098 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71997887, jitterRate=0.07285211980342865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:23,098 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:23,098 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:23,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:23,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:23,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:23,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 02:01:23,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 02:01:23,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:23,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:23,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:23,109 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:23,110 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:23,110 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:23,110 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:23,111 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:23,112 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,113 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:23,113 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:23,114 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:23,114 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:23,114 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:23,115 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,115 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:23,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,35533,1676426482890, sessionid=0x10163ddd6650000, setting cluster-up flag (Was=false) 2023-02-15 02:01:23,118 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:23,121 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,122 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,124 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:23,125 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:23,125 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.hbase-snapshot/.tmp 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:23,132 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426513135 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:23,136 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:23,136 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,137 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:23,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:23,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:23,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:23,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:23,137 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:23,138 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426483138,5,FailOnTimeoutGroup] 2023-02-15 02:01:23,138 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426483138,5,FailOnTimeoutGroup] 2023-02-15 02:01:23,138 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,138 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:23,138 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,138 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,138 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:23,149 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:23,149 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:23,149 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056 2023-02-15 02:01:23,159 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:23,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:23,163 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/info 2023-02-15 02:01:23,164 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:23,164 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,164 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:23,165 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:23,165 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:23,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:23,167 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/table 2023-02-15 02:01:23,167 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:23,167 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,168 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740 2023-02-15 02:01:23,168 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740 2023-02-15 02:01:23,169 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:23,170 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:23,172 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59798409, jitterRate=-0.10893426835536957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:23,172 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:23,172 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:23,172 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:23,173 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:23,173 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:23,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:23,174 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:23,175 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:23,208 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(952): ClusterId : 4ac9a167-4504-4cc1-99ae-7a5a1b7a17fc 2023-02-15 02:01:23,208 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(952): ClusterId : 4ac9a167-4504-4cc1-99ae-7a5a1b7a17fc 2023-02-15 02:01:23,208 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:23,208 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:23,209 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:23,209 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:23,209 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:23,209 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:23,210 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:23,211 DEBUG [RS:0;jenkins-hbase20:35603] zookeeper.ReadOnlyZKClient(139): Connect 0x75a716d3 to 127.0.0.1:52277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:23,211 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:23,212 DEBUG [RS:1;jenkins-hbase20:40913] zookeeper.ReadOnlyZKClient(139): Connect 0x310c16b6 to 127.0.0.1:52277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:23,216 DEBUG [RS:0;jenkins-hbase20:35603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b60e617, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:23,216 DEBUG [RS:1;jenkins-hbase20:40913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fcbfee7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:23,216 DEBUG [RS:0;jenkins-hbase20:35603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f5f7da3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:23,216 DEBUG [RS:1;jenkins-hbase20:40913] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bf47dc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:23,223 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:35603 2023-02-15 02:01:23,223 INFO [RS:0;jenkins-hbase20:35603] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:23,223 INFO [RS:0;jenkins-hbase20:35603] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:23,223 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:23,224 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,35533,1676426482890 with isa=jenkins-hbase20.apache.org/148.251.75.209:35603, startcode=1676426482936 2023-02-15 02:01:23,224 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:40913 2023-02-15 02:01:23,224 INFO [RS:1;jenkins-hbase20:40913] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:23,224 INFO [RS:1;jenkins-hbase20:40913] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:23,224 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:23,224 DEBUG [RS:0;jenkins-hbase20:35603] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:23,224 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,35533,1676426482890 with isa=jenkins-hbase20.apache.org/148.251.75.209:40913, startcode=1676426482965 2023-02-15 02:01:23,224 DEBUG [RS:1;jenkins-hbase20:40913] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:23,226 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48619, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:23,226 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51323, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:23,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35533] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,228 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,229 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056 2023-02-15 02:01:23,229 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33627 2023-02-15 02:01:23,229 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:23,229 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056 2023-02-15 02:01:23,229 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33627 2023-02-15 02:01:23,229 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:23,231 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:23,231 DEBUG [RS:0;jenkins-hbase20:35603] zookeeper.ZKUtil(162): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,231 DEBUG [RS:1;jenkins-hbase20:40913] zookeeper.ZKUtil(162): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,231 WARN [RS:0;jenkins-hbase20:35603] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:23,232 WARN [RS:1;jenkins-hbase20:40913] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:23,232 INFO [RS:0;jenkins-hbase20:35603] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:23,232 INFO [RS:1;jenkins-hbase20:40913] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:23,232 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,232 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,40913,1676426482965] 2023-02-15 02:01:23,232 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35603,1676426482936] 2023-02-15 02:01:23,232 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,237 DEBUG [RS:0;jenkins-hbase20:35603] zookeeper.ZKUtil(162): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,237 DEBUG [RS:1;jenkins-hbase20:40913] zookeeper.ZKUtil(162): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,238 DEBUG [RS:0;jenkins-hbase20:35603] zookeeper.ZKUtil(162): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,238 DEBUG [RS:1;jenkins-hbase20:40913] zookeeper.ZKUtil(162): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,238 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:23,238 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:23,238 INFO [RS:0;jenkins-hbase20:35603] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:23,238 INFO [RS:1;jenkins-hbase20:40913] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:23,239 INFO [RS:0;jenkins-hbase20:35603] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:23,240 INFO [RS:0;jenkins-hbase20:35603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:23,240 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,242 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:23,243 INFO [RS:1;jenkins-hbase20:40913] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:23,243 INFO [RS:1;jenkins-hbase20:40913] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:23,243 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,244 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:23,244 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,244 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,244 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,244 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:0;jenkins-hbase20:35603] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,245 DEBUG [RS:1;jenkins-hbase20:40913] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:23,247 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,247 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,248 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,248 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,248 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,248 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,259 INFO [RS:1;jenkins-hbase20:40913] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:23,259 INFO [RS:0;jenkins-hbase20:35603] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:23,259 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40913,1676426482965-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,259 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35603,1676426482936-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,269 INFO [RS:0;jenkins-hbase20:35603] regionserver.Replication(203): jenkins-hbase20.apache.org,35603,1676426482936 started 2023-02-15 02:01:23,269 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,35603,1676426482936, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35603, sessionid=0x10163ddd6650001 2023-02-15 02:01:23,269 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:23,269 DEBUG [RS:0;jenkins-hbase20:35603] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,269 DEBUG [RS:0;jenkins-hbase20:35603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35603,1676426482936' 2023-02-15 02:01:23,269 DEBUG [RS:0;jenkins-hbase20:35603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:23,269 INFO [RS:1;jenkins-hbase20:40913] regionserver.Replication(203): jenkins-hbase20.apache.org,40913,1676426482965 started 2023-02-15 02:01:23,269 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,40913,1676426482965, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:40913, sessionid=0x10163ddd6650002 2023-02-15 02:01:23,269 DEBUG [RS:0;jenkins-hbase20:35603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:23,270 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:23,270 DEBUG [RS:1;jenkins-hbase20:40913] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,270 DEBUG [RS:1;jenkins-hbase20:40913] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40913,1676426482965' 2023-02-15 02:01:23,270 DEBUG [RS:1;jenkins-hbase20:40913] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:23,270 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:23,270 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:23,270 DEBUG [RS:0;jenkins-hbase20:35603] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,270 DEBUG [RS:0;jenkins-hbase20:35603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35603,1676426482936' 2023-02-15 02:01:23,270 DEBUG [RS:1;jenkins-hbase20:40913] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:23,270 DEBUG [RS:0;jenkins-hbase20:35603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:23,270 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:23,271 DEBUG [RS:0;jenkins-hbase20:35603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:23,271 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:23,271 DEBUG [RS:1;jenkins-hbase20:40913] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:23,271 DEBUG [RS:1;jenkins-hbase20:40913] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40913,1676426482965' 2023-02-15 02:01:23,271 DEBUG [RS:1;jenkins-hbase20:40913] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:23,271 DEBUG [RS:0;jenkins-hbase20:35603] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:23,271 INFO [RS:0;jenkins-hbase20:35603] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:23,271 INFO [RS:0;jenkins-hbase20:35603] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:23,271 DEBUG [RS:1;jenkins-hbase20:40913] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:23,271 DEBUG [RS:1;jenkins-hbase20:40913] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:23,271 INFO [RS:1;jenkins-hbase20:40913] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:23,271 INFO [RS:1;jenkins-hbase20:40913] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:23,326 DEBUG [jenkins-hbase20:35533] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:23,326 DEBUG [jenkins-hbase20:35533] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:23,327 DEBUG [jenkins-hbase20:35533] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:23,327 DEBUG [jenkins-hbase20:35533] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:23,327 DEBUG [jenkins-hbase20:35533] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:23,328 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35603,1676426482936, state=OPENING 2023-02-15 02:01:23,329 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:23,330 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:23,330 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:23,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35603,1676426482936}] 2023-02-15 02:01:23,484 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:23,485 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:23,486 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:23,491 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:23,491 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:23,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35603%2C1676426482936.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,35603,1676426482936, archiveDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/oldWALs, maxLogs=32 2023-02-15 02:01:23,504 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK] 2023-02-15 02:01:23,505 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK] 2023-02-15 02:01:23,507 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,35603,1676426482936/jenkins-hbase20.apache.org%2C35603%2C1676426482936.meta.1676426483493.meta 2023-02-15 02:01:23,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK], DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK]] 2023-02-15 02:01:23,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:23,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:23,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:23,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:23,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:23,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:23,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:23,509 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:23,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:23,511 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/info 2023-02-15 02:01:23,511 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/info 2023-02-15 02:01:23,512 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:23,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:23,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:23,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:23,514 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:23,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:23,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/table 2023-02-15 02:01:23,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/table 2023-02-15 02:01:23,516 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:23,516 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:23,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740 2023-02-15 02:01:23,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740 2023-02-15 02:01:23,519 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:23,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:23,521 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69075116, jitterRate=0.029299437999725342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:23,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:23,521 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426483484 2023-02-15 02:01:23,525 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:23,526 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:23,526 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35603,1676426482936, state=OPEN 2023-02-15 02:01:23,527 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:23,527 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:23,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:23,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35603,1676426482936 in 197 msec 2023-02-15 02:01:23,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:23,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-15 02:01:23,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 400 msec 2023-02-15 02:01:23,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426483532, completionTime=-1 2023-02-15 02:01:23,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:23,532 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:23,535 DEBUG [hconnection-0x110daed3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:23,537 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47880, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:23,538 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:23,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426543539 2023-02-15 02:01:23,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426603539 2023-02-15 02:01:23,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 02:01:23,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35533,1676426482890-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35533,1676426482890-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35533,1676426482890-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:35533, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:23,546 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:23,547 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:23,548 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:23,549 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:23,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:23,550 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:23,551 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:23,552 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7 empty. 2023-02-15 02:01:23,552 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:23,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:23,967 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:23,968 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 12d2987f93e659ab76af739c79a5dda7, NAME => 'hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp 2023-02-15 02:01:23,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:23,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 12d2987f93e659ab76af739c79a5dda7, disabling compactions & flushes 2023-02-15 02:01:23,975 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:23,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:23,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. after waiting 0 ms 2023-02-15 02:01:23,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:23,975 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:23,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 12d2987f93e659ab76af739c79a5dda7: 2023-02-15 02:01:23,977 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:23,978 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426483978"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426483978"}]},"ts":"1676426483978"} 2023-02-15 02:01:23,980 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:23,981 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:23,981 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426483981"}]},"ts":"1676426483981"} 2023-02-15 02:01:23,982 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:23,984 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:23,985 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:23,985 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:23,985 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:23,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12d2987f93e659ab76af739c79a5dda7, ASSIGN}] 2023-02-15 02:01:23,988 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12d2987f93e659ab76af739c79a5dda7, ASSIGN 2023-02-15 02:01:23,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=12d2987f93e659ab76af739c79a5dda7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40913,1676426482965; forceNewPlan=false, retain=false 2023-02-15 02:01:24,139 INFO [jenkins-hbase20:35533] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:24,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12d2987f93e659ab76af739c79a5dda7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:24,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426484140"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426484140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426484140"}]},"ts":"1676426484140"} 2023-02-15 02:01:24,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 12d2987f93e659ab76af739c79a5dda7, server=jenkins-hbase20.apache.org,40913,1676426482965}] 2023-02-15 02:01:24,273 INFO [RS:1;jenkins-hbase20:40913] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40913%2C1676426482965, suffix=, logDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,40913,1676426482965, archiveDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/oldWALs, maxLogs=32 2023-02-15 02:01:24,277 INFO [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35603%2C1676426482936, suffix=, logDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,35603,1676426482936, archiveDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/oldWALs, maxLogs=32 2023-02-15 02:01:24,287 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK] 2023-02-15 02:01:24,287 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK] 2023-02-15 02:01:24,291 INFO [RS:1;jenkins-hbase20:40913] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,40913,1676426482965/jenkins-hbase20.apache.org%2C40913%2C1676426482965.1676426484273 2023-02-15 02:01:24,291 DEBUG [RS:1;jenkins-hbase20:40913] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK], DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK]] 2023-02-15 02:01:24,295 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:24,295 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:24,297 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK] 2023-02-15 02:01:24,297 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK] 2023-02-15 02:01:24,299 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34588, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:24,300 INFO [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,35603,1676426482936/jenkins-hbase20.apache.org%2C35603%2C1676426482936.1676426484277 2023-02-15 02:01:24,303 DEBUG [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32943,DS-75cea458-40f4-475d-8b5a-c7a37083ce9c,DISK], DatanodeInfoWithStorage[127.0.0.1:44911,DS-0198552e-462c-4c60-a5f7-20361aeabc58,DISK]] 2023-02-15 02:01:24,303 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:24,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12d2987f93e659ab76af739c79a5dda7, NAME => 'hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:24,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:24,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,305 INFO [StoreOpener-12d2987f93e659ab76af739c79a5dda7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,306 DEBUG [StoreOpener-12d2987f93e659ab76af739c79a5dda7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/info 2023-02-15 02:01:24,306 DEBUG [StoreOpener-12d2987f93e659ab76af739c79a5dda7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/info 2023-02-15 02:01:24,307 INFO [StoreOpener-12d2987f93e659ab76af739c79a5dda7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12d2987f93e659ab76af739c79a5dda7 columnFamilyName info 2023-02-15 02:01:24,307 INFO [StoreOpener-12d2987f93e659ab76af739c79a5dda7-1] regionserver.HStore(310): Store=12d2987f93e659ab76af739c79a5dda7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:24,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,310 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:24,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:24,314 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 12d2987f93e659ab76af739c79a5dda7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68111845, jitterRate=0.014945581555366516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:24,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 12d2987f93e659ab76af739c79a5dda7: 2023-02-15 02:01:24,315 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7., pid=6, masterSystemTime=1676426484295 2023-02-15 02:01:24,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:24,320 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:24,320 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12d2987f93e659ab76af739c79a5dda7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:24,320 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426484318"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426484318"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426484318"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426484318"}]},"ts":"1676426484318"} 2023-02-15 02:01:24,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:24,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 12d2987f93e659ab76af739c79a5dda7, server=jenkins-hbase20.apache.org,40913,1676426482965 in 179 msec 2023-02-15 02:01:24,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:24,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=12d2987f93e659ab76af739c79a5dda7, ASSIGN in 338 msec 2023-02-15 02:01:24,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:24,325 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426484325"}]},"ts":"1676426484325"} 2023-02-15 02:01:24,326 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:24,328 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:24,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 781 msec 2023-02-15 02:01:24,349 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:24,350 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:24,350 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:24,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:24,354 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:24,355 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:24,364 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:24,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 02:01:24,367 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:24,379 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:24,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-15 02:01:24,399 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:24,401 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:24,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.387sec 2023-02-15 02:01:24,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:24,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:24,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:24,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35533,1676426482890-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:24,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35533,1676426482890-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:24,402 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:24,408 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ReadOnlyZKClient(139): Connect 0x08c1421a to 127.0.0.1:52277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:24,416 DEBUG [Listener at localhost.localdomain/46729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30aefc5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:24,418 DEBUG [hconnection-0x794e53e6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:24,419 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46596, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:24,421 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:24,421 DEBUG [Listener at localhost.localdomain/46729] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:24,423 DEBUG [Listener at localhost.localdomain/46729] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:24,425 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50472, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:24,425 INFO [Listener at localhost.localdomain/46729] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:24,426 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:24,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:24,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 148.251.75.209:50472 deadline: 1676426544426, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:24,426 INFO [Listener at localhost.localdomain/46729] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 02:01:24,429 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:24,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:24,432 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:24,432 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-15 02:01:24,432 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:24,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:24,434 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,434 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 empty. 2023-02-15 02:01:24,435 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,435 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 02:01:24,444 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:24,445 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a5b00b18ec06c55fb6bad52827cc743, NAME => 'testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp 2023-02-15 02:01:24,452 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:24,452 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 7a5b00b18ec06c55fb6bad52827cc743, disabling compactions & flushes 2023-02-15 02:01:24,452 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,453 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,453 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. after waiting 0 ms 2023-02-15 02:01:24,453 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,453 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,453 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 7a5b00b18ec06c55fb6bad52827cc743: 2023-02-15 02:01:24,455 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:24,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676426484455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426484455"}]},"ts":"1676426484455"} 2023-02-15 02:01:24,457 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:24,458 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:24,458 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426484458"}]},"ts":"1676426484458"} 2023-02-15 02:01:24,460 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-15 02:01:24,462 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:24,463 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:24,463 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:24,463 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:24,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, ASSIGN}] 2023-02-15 02:01:24,465 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, ASSIGN 2023-02-15 02:01:24,466 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40913,1676426482965; forceNewPlan=false, retain=false 2023-02-15 02:01:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:24,551 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:24,616 INFO [jenkins-hbase20:35533] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:24,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7a5b00b18ec06c55fb6bad52827cc743, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:24,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676426484617"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426484617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426484617"}]},"ts":"1676426484617"} 2023-02-15 02:01:24,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 7a5b00b18ec06c55fb6bad52827cc743, server=jenkins-hbase20.apache.org,40913,1676426482965}] 2023-02-15 02:01:24,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:24,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a5b00b18ec06c55fb6bad52827cc743, NAME => 'testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:24,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:24,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,776 INFO [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,777 DEBUG [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1 2023-02-15 02:01:24,778 DEBUG [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1 2023-02-15 02:01:24,778 INFO [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a5b00b18ec06c55fb6bad52827cc743 columnFamilyName f1 2023-02-15 02:01:24,778 INFO [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] regionserver.HStore(310): Store=7a5b00b18ec06c55fb6bad52827cc743/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:24,778 INFO [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,780 DEBUG [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2 2023-02-15 02:01:24,780 DEBUG [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2 2023-02-15 02:01:24,780 INFO [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a5b00b18ec06c55fb6bad52827cc743 columnFamilyName f2 2023-02-15 02:01:24,780 INFO [StoreOpener-7a5b00b18ec06c55fb6bad52827cc743-1] regionserver.HStore(310): Store=7a5b00b18ec06c55fb6bad52827cc743/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:24,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:24,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:24,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:24,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7a5b00b18ec06c55fb6bad52827cc743; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66240489, jitterRate=-0.012939795851707458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:24,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7a5b00b18ec06c55fb6bad52827cc743: 2023-02-15 02:01:24,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743., pid=12, masterSystemTime=1676426484771 2023-02-15 02:01:24,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:24,789 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7a5b00b18ec06c55fb6bad52827cc743, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:24,789 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676426484789"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426484789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426484789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426484789"}]},"ts":"1676426484789"} 2023-02-15 02:01:24,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 02:01:24,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 7a5b00b18ec06c55fb6bad52827cc743, server=jenkins-hbase20.apache.org,40913,1676426482965 in 171 msec 2023-02-15 02:01:24,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 02:01:24,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, ASSIGN in 329 msec 2023-02-15 02:01:24,793 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:24,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426484793"}]},"ts":"1676426484793"} 2023-02-15 02:01:24,795 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-15 02:01:24,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:24,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 368 msec 2023-02-15 02:01:25,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:25,038 INFO [Listener at localhost.localdomain/46729] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-15 02:01:25,038 DEBUG [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-15 02:01:25,039 INFO [Listener at localhost.localdomain/46729] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:25,041 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-15 02:01:25,041 INFO [Listener at localhost.localdomain/46729] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:25,041 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-15 02:01:25,041 INFO [Listener at localhost.localdomain/46729] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:25,055 DEBUG [hconnection-0x794e53e6-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:25,069 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:25,076 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40913] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:25,189 INFO [Listener at localhost.localdomain/46729] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:25,189 INFO [Listener at localhost.localdomain/46729] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:25,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 02:01:25,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426485190 (current time:1676426485190). 2023-02-15 02:01:25,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:25,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] zookeeper.ReadOnlyZKClient(139): Connect 0x75f350f8 to 127.0.0.1:52277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:25,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cb7a3df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:25,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:25,197 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:25,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75f350f8 to 127.0.0.1:52277 2023-02-15 02:01:25,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:25,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:25,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 02:01:25,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 02:01:25,202 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 02:01:25,203 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676427085203 2023-02-15 02:01:25,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 02:01:25,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:25,204 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:25,205 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 02:01:25,205 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:25,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 02:01:25,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-15 02:01:25,207 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 02:01:25,207 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676427085207 2023-02-15 02:01:25,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 02:01:25,216 INFO [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 02:01:25,216 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:25,217 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 02:01:25,217 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 02:01:25,301 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,301 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,301 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,301 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:25,301 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:25,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:25,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:25,302 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,302 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 02:01:25,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 02:01:25,303 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 02:01:25,303 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:25,303 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35603,1676426482936' joining acquired barrier for procedure (foo) in zk 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 02:01:25,304 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40913,1676426482965' joining acquired barrier for procedure (foo) in zk 2023-02-15 02:01:25,305 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,305 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,305 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:25,305 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:25,305 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,305 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:25,305 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,305 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:25,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 02:01:25,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:25,306 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:25,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40913,1676426482965' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 02:01:25,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@617ef308[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:25,307 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 02:01:25,307 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,308 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 02:01:25,308 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,308 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:25,308 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 02:01:25,308 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 02:01:25,308 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,35603,1676426482936' in zk 2023-02-15 02:01:25,309 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 02:01:25,309 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:25,309 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 02:01:25,315 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 02:01:25,316 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:25,316 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:25,316 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. started... 2023-02-15 02:01:25,316 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7a5b00b18ec06c55fb6bad52827cc743 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 02:01:25,349 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f1/edcd93e3e4114be5925587d80a614542 2023-02-15 02:01:25,506 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:25,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 02:01:25,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:25,508 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 02:01:25,779 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f2/e29eac39a5b948c494798793ae1a8726 2023-02-15 02:01:25,785 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f1/edcd93e3e4114be5925587d80a614542 as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/edcd93e3e4114be5925587d80a614542 2023-02-15 02:01:25,790 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/edcd93e3e4114be5925587d80a614542, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:25,791 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f2/e29eac39a5b948c494798793ae1a8726 as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/e29eac39a5b948c494798793ae1a8726 2023-02-15 02:01:25,796 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/e29eac39a5b948c494798793ae1a8726, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:25,797 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 7a5b00b18ec06c55fb6bad52827cc743 in 481ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:25,797 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 02:01:25,797 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7a5b00b18ec06c55fb6bad52827cc743: 2023-02-15 02:01:25,797 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.' region-info for snapshot=foo 2023-02-15 02:01:25,798 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:25,798 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/edcd93e3e4114be5925587d80a614542] hfiles 2023-02-15 02:01:25,798 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/edcd93e3e4114be5925587d80a614542 for snapshot=foo 2023-02-15 02:01:25,798 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/e29eac39a5b948c494798793ae1a8726] hfiles 2023-02-15 02:01:25,798 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/e29eac39a5b948c494798793ae1a8726 for snapshot=foo 2023-02-15 02:01:25,803 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. completed. 2023-02-15 02:01:25,803 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 02:01:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 02:01:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 02:01:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,40913,1676426482965' in zk 2023-02-15 02:01:25,805 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,805 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 02:01:25,805 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:25,805 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 02:01:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,808 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,40913,1676426482965': 2023-02-15 02:01:25,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40913,1676426482965' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 02:01:25,808 INFO [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 02:01:25,808 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:25,808 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:25,809 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 02:01:25,809 INFO [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 02:01:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:25,810 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 02:01:25,826 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:25,826 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,826 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:25,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:25,827 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,828 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:25,829 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,833 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:25,833 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:25,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:25,833 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:25,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 02:01:25,833 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:25,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 02:01:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:25,833 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:25,833 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:25,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:25,835 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:25,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:25,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.hbase-snapshot/.tmp/foo 2023-02-15 02:01:25,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.hbase-snapshot/foo 2023-02-15 02:01:25,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-15 02:01:25,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.hbase-snapshot/.tmp/foo 2023-02-15 02:01:25,878 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.hbase-snapshot/.tmp/foo 2023-02-15 02:01:25,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676426485203Consolidate snapshot: foo at 1676426485834 (+631 ms)Loading Region manifests for foo at 1676426485835 (+1 ms)Writing data manifest for foo at 1676426485841 (+6 ms)Verifying snapshot: foo at 1676426485854 (+13 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676426485878 (+24 ms) 2023-02-15 02:01:25,880 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 02:01:25,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 676 msec 2023-02-15 02:01:26,310 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 02:01:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:26,311 INFO [Listener at localhost.localdomain/46729] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:26,315 INFO [Listener at localhost.localdomain/46729] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:26,322 INFO [Listener at localhost.localdomain/46729] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:26,353 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40913] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,431 INFO [Listener at localhost.localdomain/46729] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:26,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:26,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,440 INFO [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-15 02:01:26,440 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:26,441 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-15 02:01:26,441 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-15 02:01:26,442 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,442 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,443 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,443 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:26,443 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:26,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:26,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:26,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:26,443 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,443 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:26,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:26,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,444 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 02:01:26,444 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:26,446 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 02:01:26,446 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 02:01:26,446 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:26,450 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 02:01:26,451 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:26,451 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,451 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. started... 2023-02-15 02:01:26,451 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 02:01:26,451 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 02:01:26,451 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35603,1676426482936' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 02:01:26,451 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7a5b00b18ec06c55fb6bad52827cc743 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 02:01:26,462 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,463 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,463 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:26,467 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f1/ba6936111ee9490ea4839724d3f1145d 2023-02-15 02:01:26,487 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f2/1823012d13b244859719612584f5ffed 2023-02-15 02:01:26,491 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f1/ba6936111ee9490ea4839724d3f1145d as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/ba6936111ee9490ea4839724d3f1145d 2023-02-15 02:01:26,494 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/ba6936111ee9490ea4839724d3f1145d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:26,495 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/.tmp/f2/1823012d13b244859719612584f5ffed as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/1823012d13b244859719612584f5ffed 2023-02-15 02:01:26,500 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/1823012d13b244859719612584f5ffed, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:26,501 INFO [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 7a5b00b18ec06c55fb6bad52827cc743 in 50ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:26,501 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7a5b00b18ec06c55fb6bad52827cc743: 2023-02-15 02:01:26,501 DEBUG [rs(jenkins-hbase20.apache.org,40913,1676426482965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,501 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 02:01:26,502 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 02:01:26,502 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,502 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 02:01:26,502 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40913,1676426482965' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 02:01:26,503 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,503 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:26,503 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,503 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:26,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40913,1676426482965' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-15 02:01:26,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65417bff[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:26,505 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-15 02:01:26,505 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,505 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 02:01:26,506 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,506 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,35603,1676426482936' in zk 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,40913,1676426482965' in zk 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,35603,1676426482936' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 02:01:26,507 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,508 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 02:01:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:26,508 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:26,508 DEBUG [member: 'jenkins-hbase20.apache.org,40913,1676426482965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 02:01:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase20.apache.org,40913,1676426482965': 2023-02-15 02:01:26,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40913,1676426482965' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-15 02:01:26,511 INFO [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-15 02:01:26,511 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:26,511 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:26,511 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,511 INFO [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:26,512 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,512 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:26,512 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,512 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:26,513 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:26,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:26,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:26,513 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,513 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:26,515 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,515 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,516 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,517 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:26,517 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:26,517 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:26,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:26,517 DEBUG [(jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:26,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-15 02:01:26,518 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:26,517 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:26,517 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:26,517 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:26,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,518 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,618 DEBUG [Listener at localhost.localdomain/46729] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:26,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:26,624 INFO [Listener at localhost.localdomain/46729] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676426485190 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:26,625 DEBUG [Listener at localhost.localdomain/46729] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:33627/user/jenkins/test-data/2dd0be03-5a73-5145-1bad-005f2629e8c4/foo/428beca3-8fcd-4b2c-b38c-3498a9160e21/data/default/testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,625 INFO [Listener at localhost.localdomain/46729] snapshot.RestoreSnapshotHelper(239): region to add: 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:26,625 INFO [Listener at localhost.localdomain/46729] snapshot.RestoreSnapshotHelper(585): clone region=7a5b00b18ec06c55fb6bad52827cc743 as 7a5b00b18ec06c55fb6bad52827cc743 in snapshot foo 2023-02-15 02:01:26,626 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a5b00b18ec06c55fb6bad52827cc743, NAME => 'testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33627/user/jenkins/test-data/2dd0be03-5a73-5145-1bad-005f2629e8c4/foo/428beca3-8fcd-4b2c-b38c-3498a9160e21 2023-02-15 02:01:26,633 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:26,633 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink edcd93e3e4114be5925587d80a614542 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,635 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e29eac39a5b948c494798793ae1a8726 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,637 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7a5b00b18ec06c55fb6bad52827cc743, disabling compactions & flushes 2023-02-15 02:01:26,637 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,637 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,637 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. after waiting 0 ms 2023-02-15 02:01:26,637 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,637 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,637 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7a5b00b18ec06c55fb6bad52827cc743: 2023-02-15 02:01:26,637 INFO [Listener at localhost.localdomain/46729] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676426485190 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:26,637 DEBUG [Listener at localhost.localdomain/46729] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:33627/user/jenkins/test-data/2dd0be03-5a73-5145-1bad-005f2629e8c4/foo/428beca3-8fcd-4b2c-b38c-3498a9160e21 2023-02-15 02:01:26,637 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:33627/user/jenkins/test-data/2dd0be03-5a73-5145-1bad-005f2629e8c4/foo/428beca3-8fcd-4b2c-b38c-3498a9160e21 2023-02-15 02:01:26,638 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:26,638 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:26,639 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-15 02:01:26,639 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(699): |----------7a5b00b18ec06c55fb6bad52827cc743/ 2023-02-15 02:01:26,639 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:26,640 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:26,640 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=7a5b00b18ec06c55fb6bad52827cc743-edcd93e3e4114be5925587d80a614542 2023-02-15 02:01:26,640 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:26,640 DEBUG [Listener at localhost.localdomain/46729] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=7a5b00b18ec06c55fb6bad52827cc743-e29eac39a5b948c494798793ae1a8726 2023-02-15 02:01:26,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-15 02:01:26,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 02:01:26,646 INFO [Listener at localhost.localdomain/46729] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,646 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,649 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426486649"}]},"ts":"1676426486649"} 2023-02-15 02:01:26,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:26,650 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-15 02:01:26,651 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-15 02:01:26,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, UNASSIGN}] 2023-02-15 02:01:26,652 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, UNASSIGN 2023-02-15 02:01:26,653 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7a5b00b18ec06c55fb6bad52827cc743, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:26,653 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676426486653"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426486653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426486653"}]},"ts":"1676426486653"} 2023-02-15 02:01:26,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 7a5b00b18ec06c55fb6bad52827cc743, server=jenkins-hbase20.apache.org,40913,1676426482965}] 2023-02-15 02:01:26,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:26,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:26,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7a5b00b18ec06c55fb6bad52827cc743, disabling compactions & flushes 2023-02-15 02:01:26,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. after waiting 0 ms 2023-02-15 02:01:26,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:26,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743. 2023-02-15 02:01:26,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7a5b00b18ec06c55fb6bad52827cc743: 2023-02-15 02:01:26,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:26,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7a5b00b18ec06c55fb6bad52827cc743, regionState=CLOSED 2023-02-15 02:01:26,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676426486814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426486814"}]},"ts":"1676426486814"} 2023-02-15 02:01:26,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 02:01:26,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 7a5b00b18ec06c55fb6bad52827cc743, server=jenkins-hbase20.apache.org,40913,1676426482965 in 162 msec 2023-02-15 02:01:26,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 02:01:26,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a5b00b18ec06c55fb6bad52827cc743, UNASSIGN in 165 msec 2023-02-15 02:01:26,820 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426486820"}]},"ts":"1676426486820"} 2023-02-15 02:01:26,821 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-15 02:01:26,822 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-15 02:01:26,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-15 02:01:26,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:26,952 INFO [Listener at localhost.localdomain/46729] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-15 02:01:26,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,956 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:26,959 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:26,961 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1, FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2, FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/recovered.edits] 2023-02-15 02:01:26,964 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/ba6936111ee9490ea4839724d3f1145d to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/archive/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/ba6936111ee9490ea4839724d3f1145d 2023-02-15 02:01:26,965 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/edcd93e3e4114be5925587d80a614542 to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/archive/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f1/edcd93e3e4114be5925587d80a614542 2023-02-15 02:01:26,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/1823012d13b244859719612584f5ffed to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/archive/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/1823012d13b244859719612584f5ffed 2023-02-15 02:01:26,969 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/e29eac39a5b948c494798793ae1a8726 to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/archive/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/f2/e29eac39a5b948c494798793ae1a8726 2023-02-15 02:01:26,971 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/recovered.edits/12.seqid to hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/archive/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743/recovered.edits/12.seqid 2023-02-15 02:01:26,972 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a5b00b18ec06c55fb6bad52827cc743 2023-02-15 02:01:26,972 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 02:01:26,973 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,976 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-15 02:01:26,978 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-15 02:01:26,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-15 02:01:26,979 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426486979"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:26,980 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 02:01:26,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7a5b00b18ec06c55fb6bad52827cc743, NAME => 'testInitTableSnapshotMapperJobConfig,,1676426484429.7a5b00b18ec06c55fb6bad52827cc743.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 02:01:26,981 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-15 02:01:26,981 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676426486981"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:26,984 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-15 02:01:26,986 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 02:01:26,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 33 msec 2023-02-15 02:01:27,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:27,058 INFO [Listener at localhost.localdomain/46729] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-15 02:01:27,058 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:27,059 INFO [Listener at localhost.localdomain/46729] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:27,059 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08c1421a to 127.0.0.1:52277 2023-02-15 02:01:27,059 DEBUG [Listener at localhost.localdomain/46729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,059 DEBUG [Listener at localhost.localdomain/46729] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:27,059 DEBUG [Listener at localhost.localdomain/46729] util.JVMClusterUtil(257): Found active master hash=87827363, stopped=false 2023-02-15 02:01:27,059 INFO [Listener at localhost.localdomain/46729] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:27,060 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:27,060 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:27,060 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:27,060 INFO [Listener at localhost.localdomain/46729] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:27,060 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:27,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:27,063 DEBUG [Listener at localhost.localdomain/46729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d8a4058 to 127.0.0.1:52277 2023-02-15 02:01:27,063 DEBUG [Listener at localhost.localdomain/46729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:27,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:27,063 INFO [Listener at localhost.localdomain/46729] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35603,1676426482936' ***** 2023-02-15 02:01:27,063 INFO [Listener at localhost.localdomain/46729] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:27,063 INFO [Listener at localhost.localdomain/46729] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,40913,1676426482965' ***** 2023-02-15 02:01:27,063 INFO [Listener at localhost.localdomain/46729] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:27,064 INFO [RS:1;jenkins-hbase20:40913] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:27,064 INFO [RS:1;jenkins-hbase20:40913] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:27,064 INFO [RS:1;jenkins-hbase20:40913] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:27,064 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(3304): Received CLOSE for 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:27,063 INFO [RS:0;jenkins-hbase20:35603] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:27,065 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:27,065 INFO [RS:0;jenkins-hbase20:35603] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:27,066 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:27,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 12d2987f93e659ab76af739c79a5dda7, disabling compactions & flushes 2023-02-15 02:01:27,064 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:27,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:27,066 INFO [RS:0;jenkins-hbase20:35603] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:27,065 DEBUG [RS:1;jenkins-hbase20:40913] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x310c16b6 to 127.0.0.1:52277 2023-02-15 02:01:27,067 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:27,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:27,067 DEBUG [RS:0;jenkins-hbase20:35603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75a716d3 to 127.0.0.1:52277 2023-02-15 02:01:27,067 DEBUG [RS:1;jenkins-hbase20:40913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,067 DEBUG [RS:0;jenkins-hbase20:35603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. after waiting 0 ms 2023-02-15 02:01:27,067 INFO [RS:0;jenkins-hbase20:35603] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:27,067 INFO [RS:0;jenkins-hbase20:35603] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:27,067 INFO [RS:0;jenkins-hbase20:35603] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:27,067 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 02:01:27,067 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:27,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:27,067 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1479): Online Regions={12d2987f93e659ab76af739c79a5dda7=hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7.} 2023-02-15 02:01:27,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 12d2987f93e659ab76af739c79a5dda7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:27,067 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 02:01:27,067 DEBUG [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1505): Waiting on 12d2987f93e659ab76af739c79a5dda7 2023-02-15 02:01:27,067 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 02:01:27,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:27,068 DEBUG [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 02:01:27,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:27,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:27,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:27,068 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:27,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-15 02:01:27,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/.tmp/info/8f2f32445be54adda963de3b4836a809 2023-02-15 02:01:27,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/.tmp/info/70addc9bda8a4726b583e2c0883b817c 2023-02-15 02:01:27,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70addc9bda8a4726b583e2c0883b817c 2023-02-15 02:01:27,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/.tmp/info/8f2f32445be54adda963de3b4836a809 as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/info/8f2f32445be54adda963de3b4836a809 2023-02-15 02:01:27,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/info/8f2f32445be54adda963de3b4836a809, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:27,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 12d2987f93e659ab76af739c79a5dda7 in 28ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:27,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/.tmp/rep_barrier/f432714f8ffc44d4b9e413cde08b19fc 2023-02-15 02:01:27,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/namespace/12d2987f93e659ab76af739c79a5dda7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:27,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:27,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 12d2987f93e659ab76af739c79a5dda7: 2023-02-15 02:01:27,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426483547.12d2987f93e659ab76af739c79a5dda7. 2023-02-15 02:01:27,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f432714f8ffc44d4b9e413cde08b19fc 2023-02-15 02:01:27,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/.tmp/table/40c53f372c2844aea06f52902acdc843 2023-02-15 02:01:27,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40c53f372c2844aea06f52902acdc843 2023-02-15 02:01:27,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/.tmp/info/70addc9bda8a4726b583e2c0883b817c as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/info/70addc9bda8a4726b583e2c0883b817c 2023-02-15 02:01:27,122 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70addc9bda8a4726b583e2c0883b817c 2023-02-15 02:01:27,122 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/info/70addc9bda8a4726b583e2c0883b817c, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 02:01:27,123 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/.tmp/rep_barrier/f432714f8ffc44d4b9e413cde08b19fc as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/rep_barrier/f432714f8ffc44d4b9e413cde08b19fc 2023-02-15 02:01:27,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f432714f8ffc44d4b9e413cde08b19fc 2023-02-15 02:01:27,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/rep_barrier/f432714f8ffc44d4b9e413cde08b19fc, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 02:01:27,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/.tmp/table/40c53f372c2844aea06f52902acdc843 as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/table/40c53f372c2844aea06f52902acdc843 2023-02-15 02:01:27,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40c53f372c2844aea06f52902acdc843 2023-02-15 02:01:27,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/table/40c53f372c2844aea06f52902acdc843, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 02:01:27,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4345, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 65ms, sequenceid=21, compaction requested=false 2023-02-15 02:01:27,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 02:01:27,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:27,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:27,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:27,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:27,154 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:27,154 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:27,268 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35603,1676426482936; all regions closed. 2023-02-15 02:01:27,268 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,40913,1676426482965; all regions closed. 2023-02-15 02:01:27,273 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,40913,1676426482965/jenkins-hbase20.apache.org%2C40913%2C1676426482965.1676426484273 not finished, retry = 0 2023-02-15 02:01:27,273 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/WALs/jenkins-hbase20.apache.org,35603,1676426482936/jenkins-hbase20.apache.org%2C35603%2C1676426482936.meta.1676426483493.meta not finished, retry = 0 2023-02-15 02:01:27,319 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 02:01:27,319 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 02:01:27,341 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 02:01:27,342 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 02:01:27,375 DEBUG [RS:1;jenkins-hbase20:40913] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/oldWALs 2023-02-15 02:01:27,376 DEBUG [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/oldWALs 2023-02-15 02:01:27,376 INFO [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35603%2C1676426482936.meta:.meta(num 1676426483493) 2023-02-15 02:01:27,376 INFO [RS:1;jenkins-hbase20:40913] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40913%2C1676426482965:(num 1676426484273) 2023-02-15 02:01:27,376 DEBUG [RS:1;jenkins-hbase20:40913] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,376 INFO [RS:1;jenkins-hbase20:40913] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:27,376 INFO [RS:1;jenkins-hbase20:40913] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:27,376 INFO [RS:1;jenkins-hbase20:40913] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:27,376 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:27,376 INFO [RS:1;jenkins-hbase20:40913] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:27,376 INFO [RS:1;jenkins-hbase20:40913] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:27,377 INFO [RS:1;jenkins-hbase20:40913] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40913 2023-02-15 02:01:27,380 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:27,380 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:27,380 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:27,380 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,40913,1676426482965 2023-02-15 02:01:27,380 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:27,380 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c70fb6e rejected from java.util.concurrent.ThreadPoolExecutor@784f6038[Shutting down, pool size = 1, active threads = 0, queued tasks = 1, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,380 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,40913,1676426482965] 2023-02-15 02:01:27,380 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,40913,1676426482965; numProcessing=1 2023-02-15 02:01:27,381 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,40913,1676426482965 already deleted, retry=false 2023-02-15 02:01:27,381 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,40913,1676426482965 expired; onlineServers=1 2023-02-15 02:01:27,382 DEBUG [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/oldWALs 2023-02-15 02:01:27,382 INFO [RS:0;jenkins-hbase20:35603] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35603%2C1676426482936:(num 1676426484277) 2023-02-15 02:01:27,382 DEBUG [RS:0;jenkins-hbase20:35603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,382 INFO [RS:0;jenkins-hbase20:35603] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:27,382 INFO [RS:0;jenkins-hbase20:35603] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:27,383 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:27,383 INFO [RS:0;jenkins-hbase20:35603] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35603 2023-02-15 02:01:27,384 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:27,384 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35603,1676426482936 2023-02-15 02:01:27,384 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f69d8d3 rejected from java.util.concurrent.ThreadPoolExecutor@1b565fe6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,385 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35603,1676426482936] 2023-02-15 02:01:27,385 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35603,1676426482936; numProcessing=2 2023-02-15 02:01:27,385 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35603,1676426482936 already deleted, retry=false 2023-02-15 02:01:27,385 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,35603,1676426482936 expired; onlineServers=0 2023-02-15 02:01:27,385 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35533,1676426482890' ***** 2023-02-15 02:01:27,385 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:27,386 DEBUG [M:0;jenkins-hbase20:35533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103b7dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:27,386 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35533,1676426482890 2023-02-15 02:01:27,386 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35533,1676426482890; all regions closed. 2023-02-15 02:01:27,386 DEBUG [M:0;jenkins-hbase20:35533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:27,386 DEBUG [M:0;jenkins-hbase20:35533] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:27,386 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:27,386 DEBUG [M:0;jenkins-hbase20:35533] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:27,386 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426483138] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426483138,5,FailOnTimeoutGroup] 2023-02-15 02:01:27,386 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426483138] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426483138,5,FailOnTimeoutGroup] 2023-02-15 02:01:27,387 INFO [M:0;jenkins-hbase20:35533] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:27,388 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:27,388 INFO [M:0;jenkins-hbase20:35533] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:27,388 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:27,388 INFO [M:0;jenkins-hbase20:35533] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:27,388 DEBUG [M:0;jenkins-hbase20:35533] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:27,388 INFO [M:0;jenkins-hbase20:35533] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:27,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:27,388 ERROR [M:0;jenkins-hbase20:35533] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 02:01:27,388 INFO [M:0;jenkins-hbase20:35533] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:27,388 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:27,389 DEBUG [M:0;jenkins-hbase20:35533] zookeeper.ZKUtil(398): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 02:01:27,389 WARN [M:0;jenkins-hbase20:35533] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 02:01:27,389 INFO [M:0;jenkins-hbase20:35533] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:27,389 INFO [M:0;jenkins-hbase20:35533] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:27,390 DEBUG [M:0;jenkins-hbase20:35533] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:27,390 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:27,390 DEBUG [M:0;jenkins-hbase20:35533] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:27,390 DEBUG [M:0;jenkins-hbase20:35533] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:27,390 DEBUG [M:0;jenkins-hbase20:35533] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:27,390 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.92 KB heapSize=66.89 KB 2023-02-15 02:01:27,398 INFO [M:0;jenkins-hbase20:35533] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.92 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a1068440ae045b1869323832641aaf8 2023-02-15 02:01:27,403 DEBUG [M:0;jenkins-hbase20:35533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a1068440ae045b1869323832641aaf8 as hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a1068440ae045b1869323832641aaf8 2023-02-15 02:01:27,407 INFO [M:0;jenkins-hbase20:35533] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33627/user/jenkins/test-data/b8d2dbae-53e8-c8d4-179e-e657c8b25056/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a1068440ae045b1869323832641aaf8, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 02:01:27,407 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegion(2947): Finished flush of dataSize ~55.92 KB/57267, heapSize ~66.88 KB/68480, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-15 02:01:27,408 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:27,408 DEBUG [M:0;jenkins-hbase20:35533] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:27,411 INFO [M:0;jenkins-hbase20:35533] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:27,411 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:27,412 INFO [M:0;jenkins-hbase20:35533] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35533 2023-02-15 02:01:27,413 DEBUG [M:0;jenkins-hbase20:35533] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,35533,1676426482890 already deleted, retry=false 2023-02-15 02:01:27,481 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:27,481 INFO [RS:1;jenkins-hbase20:40913] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,40913,1676426482965; zookeeper connection closed. 2023-02-15 02:01:27,481 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@776a40ff rejected from java.util.concurrent.ThreadPoolExecutor@784f6038[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,482 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4ba1e227] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4ba1e227 2023-02-15 02:01:27,482 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:40913-0x10163ddd6650002, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:27,482 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f7781f8 rejected from java.util.concurrent.ThreadPoolExecutor@784f6038[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,581 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:27,581 INFO [M:0;jenkins-hbase20:35533] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35533,1676426482890; zookeeper connection closed. 2023-02-15 02:01:27,582 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30826121 rejected from java.util.concurrent.ThreadPoolExecutor@34bde3e9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,582 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): master:35533-0x10163ddd6650000, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:27,582 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@632c24f4 rejected from java.util.concurrent.ThreadPoolExecutor@34bde3e9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,682 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:27,682 INFO [RS:0;jenkins-hbase20:35603] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35603,1676426482936; zookeeper connection closed. 2023-02-15 02:01:27,682 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ebe5730 rejected from java.util.concurrent.ThreadPoolExecutor@1b565fe6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,682 DEBUG [Listener at localhost.localdomain/46729-EventThread] zookeeper.ZKWatcher(600): regionserver:35603-0x10163ddd6650001, quorum=127.0.0.1:52277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:27,682 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@49cea2f4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@49cea2f4 2023-02-15 02:01:27,682 ERROR [Listener at localhost.localdomain/46729-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46407415 rejected from java.util.concurrent.ThreadPoolExecutor@1b565fe6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:27,682 INFO [Listener at localhost.localdomain/46729] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:27,682 WARN [Listener at localhost.localdomain/46729] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:27,686 INFO [Listener at localhost.localdomain/46729] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:27,792 WARN [BP-382364124-148.251.75.209-1676426482379 heartbeating to localhost.localdomain/127.0.0.1:33627] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:27,792 WARN [BP-382364124-148.251.75.209-1676426482379 heartbeating to localhost.localdomain/127.0.0.1:33627] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-382364124-148.251.75.209-1676426482379 (Datanode Uuid f1f0ec58-b3b9-457f-a6a0-e016e6628e3e) service to localhost.localdomain/127.0.0.1:33627 2023-02-15 02:01:27,793 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/dfs/data/data3/current/BP-382364124-148.251.75.209-1676426482379] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:27,793 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/dfs/data/data4/current/BP-382364124-148.251.75.209-1676426482379] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:27,794 WARN [Listener at localhost.localdomain/46729] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:27,797 INFO [Listener at localhost.localdomain/46729] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:27,900 WARN [BP-382364124-148.251.75.209-1676426482379 heartbeating to localhost.localdomain/127.0.0.1:33627] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:27,900 WARN [BP-382364124-148.251.75.209-1676426482379 heartbeating to localhost.localdomain/127.0.0.1:33627] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-382364124-148.251.75.209-1676426482379 (Datanode Uuid d1fe27b2-f280-4676-9913-d82ee178f2fb) service to localhost.localdomain/127.0.0.1:33627 2023-02-15 02:01:27,901 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/dfs/data/data1/current/BP-382364124-148.251.75.209-1676426482379] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:27,901 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/cluster_39027dad-1a04-f9b1-e91a-460d9092d52f/dfs/data/data2/current/BP-382364124-148.251.75.209-1676426482379] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:27,911 INFO [Listener at localhost.localdomain/46729] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:28,022 INFO [Listener at localhost.localdomain/46729] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:28,043 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:28,056 INFO [Listener at localhost.localdomain/46729] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 159) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:33627 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/46729 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:33627 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost.localdomain:33627 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:33627 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,35533,1676426482890)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost.localdomain:33627 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:33627 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:33627 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=565 (was 536) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 318), ProcessCount=163 (was 165), AvailableMemoryMB=5696 (was 5741) 2023-02-15 02:01:28,065 INFO [Listener at localhost.localdomain/46729] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=163, AvailableMemoryMB=5696 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/hadoop.log.dir so I do NOT create it in target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44 2023-02-15 02:01:28,074 WARN [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/hadoop.tmp.dir so I do NOT create it in target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44 2023-02-15 02:01:28,074 WARN [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1a032781-57e5-0cd4-5571-6b676e2700ba/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 02:01:28,074 DEBUG [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2, deleteOnExit=true 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/test.cache.data in system properties and HBase conf 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:01:28,074 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:01:28,075 DEBUG [Listener at localhost.localdomain/46729] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:28,075 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:28,076 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:01:28,076 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:01:28,076 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:01:28,076 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:28,076 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:01:28,076 INFO [Listener at localhost.localdomain/46729] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:01:28,078 WARN [Listener at localhost.localdomain/46729] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:28,078 WARN [Listener at localhost.localdomain/46729] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:28,102 WARN [Listener at localhost.localdomain/46729] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:28,103 INFO [Listener at localhost.localdomain/46729] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:28,110 INFO [Listener at localhost.localdomain/46729] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/java.io.tmpdir/Jetty_localhost_localdomain_40081_hdfs____.9qhfy1/webapp 2023-02-15 02:01:28,182 INFO [Listener at localhost.localdomain/46729] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:40081 2023-02-15 02:01:28,184 WARN [Listener at localhost.localdomain/46729] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:28,184 WARN [Listener at localhost.localdomain/46729] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:28,208 WARN [Listener at localhost.localdomain/36337] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:28,221 WARN [Listener at localhost.localdomain/36337] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:28,223 WARN [Listener at localhost.localdomain/36337] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:28,224 INFO [Listener at localhost.localdomain/36337] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:28,230 INFO [Listener at localhost.localdomain/36337] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/java.io.tmpdir/Jetty_localhost_37833_datanode____kfw49n/webapp 2023-02-15 02:01:28,302 INFO [Listener at localhost.localdomain/36337] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37833 2023-02-15 02:01:28,309 WARN [Listener at localhost.localdomain/43071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:28,328 WARN [Listener at localhost.localdomain/43071] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:28,335 WARN [Listener at localhost.localdomain/43071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:28,336 INFO [Listener at localhost.localdomain/43071] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:28,343 INFO [Listener at localhost.localdomain/43071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/java.io.tmpdir/Jetty_localhost_40131_datanode____84wr0a/webapp 2023-02-15 02:01:28,399 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcf4d2f65bd0d9d8a: Processing first storage report for DS-52378add-6753-4273-9fcf-459858976100 from datanode c06d09d4-8dd9-4517-96c2-009054991a86 2023-02-15 02:01:28,399 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcf4d2f65bd0d9d8a: from storage DS-52378add-6753-4273-9fcf-459858976100 node DatanodeRegistration(127.0.0.1:38031, datanodeUuid=c06d09d4-8dd9-4517-96c2-009054991a86, infoPort=40203, infoSecurePort=0, ipcPort=43071, storageInfo=lv=-57;cid=testClusterID;nsid=614952270;c=1676426488080), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:28,399 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcf4d2f65bd0d9d8a: Processing first storage report for DS-96e9cf05-70b6-4b86-a0e0-76f9e678c200 from datanode c06d09d4-8dd9-4517-96c2-009054991a86 2023-02-15 02:01:28,399 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcf4d2f65bd0d9d8a: from storage DS-96e9cf05-70b6-4b86-a0e0-76f9e678c200 node DatanodeRegistration(127.0.0.1:38031, datanodeUuid=c06d09d4-8dd9-4517-96c2-009054991a86, infoPort=40203, infoSecurePort=0, ipcPort=43071, storageInfo=lv=-57;cid=testClusterID;nsid=614952270;c=1676426488080), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:28,424 INFO [Listener at localhost.localdomain/43071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40131 2023-02-15 02:01:28,431 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:28,432 WARN [Listener at localhost.localdomain/39425] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:28,495 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x717f923b9b146cc2: Processing first storage report for DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76 from datanode e61aa5b6-ec0f-474a-a638-e51a20e35692 2023-02-15 02:01:28,495 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x717f923b9b146cc2: from storage DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76 node DatanodeRegistration(127.0.0.1:35625, datanodeUuid=e61aa5b6-ec0f-474a-a638-e51a20e35692, infoPort=41511, infoSecurePort=0, ipcPort=39425, storageInfo=lv=-57;cid=testClusterID;nsid=614952270;c=1676426488080), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 02:01:28,495 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x717f923b9b146cc2: Processing first storage report for DS-3bdfe5cd-d9f6-4b4a-89c5-81a7f90cf418 from datanode e61aa5b6-ec0f-474a-a638-e51a20e35692 2023-02-15 02:01:28,495 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x717f923b9b146cc2: from storage DS-3bdfe5cd-d9f6-4b4a-89c5-81a7f90cf418 node DatanodeRegistration(127.0.0.1:35625, datanodeUuid=e61aa5b6-ec0f-474a-a638-e51a20e35692, infoPort=41511, infoSecurePort=0, ipcPort=39425, storageInfo=lv=-57;cid=testClusterID;nsid=614952270;c=1676426488080), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:28,542 DEBUG [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44 2023-02-15 02:01:28,544 INFO [Listener at localhost.localdomain/39425] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/zookeeper_0, clientPort=64336, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:01:28,545 INFO [Listener at localhost.localdomain/39425] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64336 2023-02-15 02:01:28,545 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,546 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,563 INFO [Listener at localhost.localdomain/39425] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797 with version=8 2023-02-15 02:01:28,563 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,564 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,565 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/hbase-staging 2023-02-15 02:01:28,566 INFO [Listener at localhost.localdomain/39425] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:28,566 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,566 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,566 INFO [Listener at localhost.localdomain/39425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:28,566 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,567 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:28,567 INFO [Listener at localhost.localdomain/39425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:28,567 INFO [Listener at localhost.localdomain/39425] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45319 2023-02-15 02:01:28,567 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,568 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,569 INFO [Listener at localhost.localdomain/39425] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45319 connecting to ZooKeeper ensemble=127.0.0.1:64336 2023-02-15 02:01:28,574 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:453190x0, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:28,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45319-0x10163ddec8e0000 connected 2023-02-15 02:01:28,595 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:28,595 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:28,595 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:28,599 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45319 2023-02-15 02:01:28,600 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45319 2023-02-15 02:01:28,602 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45319 2023-02-15 02:01:28,607 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45319 2023-02-15 02:01:28,611 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45319 2023-02-15 02:01:28,611 INFO [Listener at localhost.localdomain/39425] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797, hbase.cluster.distributed=false 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:28,622 INFO [Listener at localhost.localdomain/39425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:28,623 INFO [Listener at localhost.localdomain/39425] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34749 2023-02-15 02:01:28,623 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:28,627 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:28,627 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,628 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,629 INFO [Listener at localhost.localdomain/39425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34749 connecting to ZooKeeper ensemble=127.0.0.1:64336 2023-02-15 02:01:28,632 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:347490x0, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:28,633 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): regionserver:347490x0, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:28,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34749-0x10163ddec8e0001 connected 2023-02-15 02:01:28,634 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:28,634 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:28,639 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34749 2023-02-15 02:01:28,639 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34749 2023-02-15 02:01:28,640 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34749 2023-02-15 02:01:28,641 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34749 2023-02-15 02:01:28,642 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34749 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:28,651 INFO [Listener at localhost.localdomain/39425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:28,652 INFO [Listener at localhost.localdomain/39425] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34457 2023-02-15 02:01:28,652 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:28,657 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:28,657 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,658 INFO [Listener at localhost.localdomain/39425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,659 INFO [Listener at localhost.localdomain/39425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34457 connecting to ZooKeeper ensemble=127.0.0.1:64336 2023-02-15 02:01:28,662 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:344570x0, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:28,663 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): regionserver:344570x0, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:28,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34457-0x10163ddec8e0002 connected 2023-02-15 02:01:28,664 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:28,665 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:28,671 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34457 2023-02-15 02:01:28,671 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34457 2023-02-15 02:01:28,672 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34457 2023-02-15 02:01:28,672 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34457 2023-02-15 02:01:28,672 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34457 2023-02-15 02:01:28,688 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,690 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:28,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,691 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:28,691 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:28,691 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:28,692 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:28,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:28,693 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,45319,1676426488566 from backup master directory 2023-02-15 02:01:28,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:28,694 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,694 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:28,694 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:28,694 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/hbase.id with ID: af9df16d-43dd-420d-a8c9-1c9086e4104c 2023-02-15 02:01:28,714 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:28,715 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:28,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0ab2bf42 to 127.0.0.1:64336 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:28,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63bf69e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:28,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:28,732 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:01:28,732 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:28,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store-tmp 2023-02-15 02:01:28,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:28,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:28,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:28,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:28,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:28,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:28,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:28,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:28,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/WALs/jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,748 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45319%2C1676426488566, suffix=, logDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/WALs/jenkins-hbase20.apache.org,45319,1676426488566, archiveDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/oldWALs, maxLogs=10 2023-02-15 02:01:28,761 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK] 2023-02-15 02:01:28,761 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK] 2023-02-15 02:01:28,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/WALs/jenkins-hbase20.apache.org,45319,1676426488566/jenkins-hbase20.apache.org%2C45319%2C1676426488566.1676426488748 2023-02-15 02:01:28,763 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK], DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK]] 2023-02-15 02:01:28,763 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:28,763 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:28,764 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:28,764 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:28,765 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:28,766 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:28,766 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:28,767 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:28,768 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:28,768 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:28,770 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:28,779 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:28,780 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66945668, jitterRate=-0.002431809902191162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:28,780 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:28,780 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:28,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:28,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:28,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:28,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 02:01:28,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 02:01:28,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:28,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:28,787 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:28,798 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:28,798 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:28,798 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:28,799 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:28,799 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:28,800 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:28,801 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:28,801 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:28,802 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:28,802 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:28,802 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:28,802 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:28,802 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:28,803 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,45319,1676426488566, sessionid=0x10163ddec8e0000, setting cluster-up flag (Was=false) 2023-02-15 02:01:28,805 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:28,807 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:28,808 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,810 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:28,812 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:28,812 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:28,813 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.hbase-snapshot/.tmp 2023-02-15 02:01:28,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:28,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426518823 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:28,824 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:28,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,824 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:28,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:28,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:28,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:28,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:28,826 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:28,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426488826,5,FailOnTimeoutGroup] 2023-02-15 02:01:28,826 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:28,827 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426488826,5,FailOnTimeoutGroup] 2023-02-15 02:01:28,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:28,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,833 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:28,833 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:28,833 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797 2023-02-15 02:01:28,848 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:28,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:28,850 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/info 2023-02-15 02:01:28,850 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:28,851 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:28,851 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:28,852 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:28,852 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:28,853 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:28,853 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:28,854 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/table 2023-02-15 02:01:28,854 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:28,855 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:28,855 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740 2023-02-15 02:01:28,856 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740 2023-02-15 02:01:28,857 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:28,858 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:28,859 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:28,860 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64744159, jitterRate=-0.03523685038089752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:28,860 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:28,860 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:28,860 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:28,860 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:28,860 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:28,860 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:28,860 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:28,860 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:28,861 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:28,861 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:28,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:28,863 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:28,865 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:28,875 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(952): ClusterId : af9df16d-43dd-420d-a8c9-1c9086e4104c 2023-02-15 02:01:28,875 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(952): ClusterId : af9df16d-43dd-420d-a8c9-1c9086e4104c 2023-02-15 02:01:28,875 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:28,875 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:28,876 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:28,876 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:28,876 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:28,876 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:28,877 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:28,878 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:28,878 DEBUG [RS:1;jenkins-hbase20:34457] zookeeper.ReadOnlyZKClient(139): Connect 0x77480556 to 127.0.0.1:64336 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:28,879 DEBUG [RS:0;jenkins-hbase20:34749] zookeeper.ReadOnlyZKClient(139): Connect 0x638dbef5 to 127.0.0.1:64336 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:28,891 DEBUG [RS:1;jenkins-hbase20:34457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@798fe5cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:28,891 DEBUG [RS:0;jenkins-hbase20:34749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d4a5cf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:28,892 DEBUG [RS:1;jenkins-hbase20:34457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7db06e26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:28,892 DEBUG [RS:0;jenkins-hbase20:34749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6975d585, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:28,898 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34457 2023-02-15 02:01:28,898 INFO [RS:1;jenkins-hbase20:34457] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:28,898 INFO [RS:1;jenkins-hbase20:34457] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:28,898 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:28,899 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45319,1676426488566 with isa=jenkins-hbase20.apache.org/148.251.75.209:34457, startcode=1676426488650 2023-02-15 02:01:28,899 DEBUG [RS:1;jenkins-hbase20:34457] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:28,900 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42683, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:28,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,902 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:34749 2023-02-15 02:01:28,902 INFO [RS:0;jenkins-hbase20:34749] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:28,902 INFO [RS:0;jenkins-hbase20:34749] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:28,902 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:28,902 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797 2023-02-15 02:01:28,902 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36337 2023-02-15 02:01:28,902 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:28,903 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45319,1676426488566 with isa=jenkins-hbase20.apache.org/148.251.75.209:34749, startcode=1676426488621 2023-02-15 02:01:28,903 DEBUG [RS:0;jenkins-hbase20:34749] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:28,904 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:28,905 DEBUG [RS:1;jenkins-hbase20:34457] zookeeper.ZKUtil(162): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,905 WARN [RS:1;jenkins-hbase20:34457] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:28,905 INFO [RS:1;jenkins-hbase20:34457] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:28,905 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,906 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34457,1676426488650] 2023-02-15 02:01:28,906 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57633, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:28,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,909 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797 2023-02-15 02:01:28,909 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36337 2023-02-15 02:01:28,909 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:28,910 DEBUG [RS:1;jenkins-hbase20:34457] zookeeper.ZKUtil(162): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,917 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:28,917 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:28,917 DEBUG [RS:0;jenkins-hbase20:34749] zookeeper.ZKUtil(162): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,917 WARN [RS:0;jenkins-hbase20:34749] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:28,917 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34749,1676426488621] 2023-02-15 02:01:28,917 INFO [RS:0;jenkins-hbase20:34749] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:28,917 DEBUG [RS:1;jenkins-hbase20:34457] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:28,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,917 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,917 INFO [RS:1;jenkins-hbase20:34457] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:28,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,920 INFO [RS:1;jenkins-hbase20:34457] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:28,920 INFO [RS:1;jenkins-hbase20:34457] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:28,920 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,921 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:28,921 DEBUG [RS:0;jenkins-hbase20:34749] zookeeper.ZKUtil(162): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,922 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,922 DEBUG [RS:0;jenkins-hbase20:34749] zookeeper.ZKUtil(162): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:1;jenkins-hbase20:34457] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,922 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:28,923 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,923 INFO [RS:0;jenkins-hbase20:34749] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:28,923 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,923 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,927 INFO [RS:0;jenkins-hbase20:34749] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:28,927 INFO [RS:0;jenkins-hbase20:34749] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:28,927 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,927 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:28,929 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,929 DEBUG [RS:0;jenkins-hbase20:34749] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:28,931 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,931 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,931 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,937 INFO [RS:1;jenkins-hbase20:34457] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:28,937 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34457,1676426488650-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,943 INFO [RS:0;jenkins-hbase20:34749] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:28,943 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34749,1676426488621-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:28,946 INFO [RS:1;jenkins-hbase20:34457] regionserver.Replication(203): jenkins-hbase20.apache.org,34457,1676426488650 started 2023-02-15 02:01:28,946 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34457,1676426488650, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34457, sessionid=0x10163ddec8e0002 2023-02-15 02:01:28,946 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:28,946 DEBUG [RS:1;jenkins-hbase20:34457] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,946 DEBUG [RS:1;jenkins-hbase20:34457] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34457,1676426488650' 2023-02-15 02:01:28,946 DEBUG [RS:1;jenkins-hbase20:34457] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:28,946 DEBUG [RS:1;jenkins-hbase20:34457] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34457,1676426488650' 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:28,947 DEBUG [RS:1;jenkins-hbase20:34457] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:28,947 INFO [RS:1;jenkins-hbase20:34457] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:28,947 INFO [RS:1;jenkins-hbase20:34457] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:28,951 INFO [RS:0;jenkins-hbase20:34749] regionserver.Replication(203): jenkins-hbase20.apache.org,34749,1676426488621 started 2023-02-15 02:01:28,952 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34749,1676426488621, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34749, sessionid=0x10163ddec8e0001 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34749,1676426488621' 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:28,952 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:28,953 DEBUG [RS:0;jenkins-hbase20:34749] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:28,953 DEBUG [RS:0;jenkins-hbase20:34749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34749,1676426488621' 2023-02-15 02:01:28,953 DEBUG [RS:0;jenkins-hbase20:34749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:28,953 DEBUG [RS:0;jenkins-hbase20:34749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:28,953 DEBUG [RS:0;jenkins-hbase20:34749] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:28,953 INFO [RS:0;jenkins-hbase20:34749] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:28,953 INFO [RS:0;jenkins-hbase20:34749] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:29,015 DEBUG [jenkins-hbase20:45319] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:29,015 DEBUG [jenkins-hbase20:45319] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:29,017 DEBUG [jenkins-hbase20:45319] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:29,017 DEBUG [jenkins-hbase20:45319] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:29,017 DEBUG [jenkins-hbase20:45319] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:29,018 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34749,1676426488621, state=OPENING 2023-02-15 02:01:29,019 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:29,020 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:29,020 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:29,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:29,173 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:29,173 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:29,174 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:29,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:29,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:29,180 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34749%2C1676426488621.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34749,1676426488621, archiveDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/oldWALs, maxLogs=32 2023-02-15 02:01:29,192 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK] 2023-02-15 02:01:29,192 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK] 2023-02-15 02:01:29,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34749,1676426488621/jenkins-hbase20.apache.org%2C34749%2C1676426488621.meta.1676426489180.meta 2023-02-15 02:01:29,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK], DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK]] 2023-02-15 02:01:29,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:29,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:29,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:29,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:29,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:29,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:29,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:29,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:29,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/info 2023-02-15 02:01:29,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/info 2023-02-15 02:01:29,197 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:29,197 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:29,197 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:29,198 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:29,198 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:29,198 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:29,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:29,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:29,200 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/table 2023-02-15 02:01:29,200 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/table 2023-02-15 02:01:29,200 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:29,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:29,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740 2023-02-15 02:01:29,202 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740 2023-02-15 02:01:29,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:29,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:29,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69377864, jitterRate=0.03381073474884033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:29,205 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:29,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426489173 2023-02-15 02:01:29,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:29,211 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:29,212 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34749,1676426488621, state=OPEN 2023-02-15 02:01:29,213 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:29,213 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:29,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:29,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34749,1676426488621 in 193 msec 2023-02-15 02:01:29,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:29,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-15 02:01:29,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 402 msec 2023-02-15 02:01:29,216 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426489216, completionTime=-1 2023-02-15 02:01:29,216 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:29,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:29,221 DEBUG [hconnection-0x23acd042-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:29,222 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:29,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:29,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426549224 2023-02-15 02:01:29,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426609224 2023-02-15 02:01:29,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-15 02:01:29,231 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45319,1676426488566-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:29,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45319,1676426488566-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:29,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45319,1676426488566-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:29,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:45319, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:29,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:29,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:29,232 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:29,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:29,233 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:29,234 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:29,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:29,236 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,237 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd empty. 2023-02-15 02:01:29,237 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,237 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:29,251 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:29,252 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7e16a400e453b263e624174295ba0bfd, NAME => 'hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,263 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7e16a400e453b263e624174295ba0bfd, disabling compactions & flushes 2023-02-15 02:01:29,264 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. after waiting 0 ms 2023-02-15 02:01:29,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,264 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,264 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7e16a400e453b263e624174295ba0bfd: 2023-02-15 02:01:29,266 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:29,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426489267"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426489267"}]},"ts":"1676426489267"} 2023-02-15 02:01:29,270 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:29,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:29,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426489270"}]},"ts":"1676426489270"} 2023-02-15 02:01:29,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:29,273 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:29,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:29,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:29,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:29,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7e16a400e453b263e624174295ba0bfd, ASSIGN}] 2023-02-15 02:01:29,280 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7e16a400e453b263e624174295ba0bfd, ASSIGN 2023-02-15 02:01:29,281 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7e16a400e453b263e624174295ba0bfd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34749,1676426488621; forceNewPlan=false, retain=false 2023-02-15 02:01:29,431 INFO [jenkins-hbase20:45319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:29,432 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7e16a400e453b263e624174295ba0bfd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:29,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426489432"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426489432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426489432"}]},"ts":"1676426489432"} 2023-02-15 02:01:29,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7e16a400e453b263e624174295ba0bfd, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:29,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,591 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34749%2C1676426488621, suffix=, logDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34749,1676426488621, archiveDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/oldWALs, maxLogs=32 2023-02-15 02:01:29,603 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK] 2023-02-15 02:01:29,603 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK] 2023-02-15 02:01:29,605 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34749,1676426488621/jenkins-hbase20.apache.org%2C34749%2C1676426488621.1676426489591 2023-02-15 02:01:29,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK], DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK]] 2023-02-15 02:01:29,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e16a400e453b263e624174295ba0bfd, NAME => 'hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:29,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,606 INFO [StoreOpener-7e16a400e453b263e624174295ba0bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,608 DEBUG [StoreOpener-7e16a400e453b263e624174295ba0bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/info 2023-02-15 02:01:29,608 DEBUG [StoreOpener-7e16a400e453b263e624174295ba0bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/info 2023-02-15 02:01:29,608 INFO [StoreOpener-7e16a400e453b263e624174295ba0bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e16a400e453b263e624174295ba0bfd columnFamilyName info 2023-02-15 02:01:29,608 INFO [StoreOpener-7e16a400e453b263e624174295ba0bfd-1] regionserver.HStore(310): Store=7e16a400e453b263e624174295ba0bfd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:29,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,611 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:29,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:29,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7e16a400e453b263e624174295ba0bfd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60111530, jitterRate=-0.1042684018611908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:29,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7e16a400e453b263e624174295ba0bfd: 2023-02-15 02:01:29,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd., pid=6, masterSystemTime=1676426489586 2023-02-15 02:01:29,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:29,616 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7e16a400e453b263e624174295ba0bfd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:29,616 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426489616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426489616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426489616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426489616"}]},"ts":"1676426489616"} 2023-02-15 02:01:29,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:29,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7e16a400e453b263e624174295ba0bfd, server=jenkins-hbase20.apache.org,34749,1676426488621 in 184 msec 2023-02-15 02:01:29,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:29,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7e16a400e453b263e624174295ba0bfd, ASSIGN in 344 msec 2023-02-15 02:01:29,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:29,621 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426489621"}]},"ts":"1676426489621"} 2023-02-15 02:01:29,622 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:29,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:29,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 392 msec 2023-02-15 02:01:29,634 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:29,641 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:29,641 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:29,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:29,650 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:29,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-15 02:01:29,655 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:29,665 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:29,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-15 02:01:29,683 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:29,684 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:29,684 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.990sec 2023-02-15 02:01:29,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:29,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:29,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:29,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45319,1676426488566-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:29,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45319,1676426488566-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:29,687 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:29,775 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ReadOnlyZKClient(139): Connect 0x51fb5e26 to 127.0.0.1:64336 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:29,780 DEBUG [Listener at localhost.localdomain/39425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4487b4f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:29,781 DEBUG [hconnection-0x6e5f1cc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:29,783 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:29,784 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:29,784 DEBUG [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:29,786 DEBUG [Listener at localhost.localdomain/39425] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:29,788 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55708, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:29,788 INFO [Listener at localhost.localdomain/39425] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 02:01:29,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-15 02:01:29,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:29,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 148.251.75.209:55708 deadline: 1676426549788, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-15 02:01:29,789 INFO [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-15 02:01:29,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:29,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:29,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:29,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-15 02:01:29,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:29,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f empty. 2023-02-15 02:01:29,805 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e empty. 2023-02-15 02:01:29,805 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 empty. 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a empty. 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba empty. 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc empty. 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 empty. 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 empty. 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:29,806 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde empty. 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 empty. 2023-02-15 02:01:29,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:29,810 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:29,810 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 02:01:29,825 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:29,826 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 67a90a7a933c0f9bbf2b1ecec93241b1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,826 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => bfd21ba6382c10b165575af177deeb8a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,826 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c2e8ff8107d18ee12b50850f53173aba, NAME => 'testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing bfd21ba6382c10b165575af177deeb8a, disabling compactions & flushes 2023-02-15 02:01:29,847 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:29,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:29,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. after waiting 0 ms 2023-02-15 02:01:29,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:29,847 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:29,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:29,847 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1be257d4bd696b7b69f1320aaa2d987f, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,849 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,849 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 67a90a7a933c0f9bbf2b1ecec93241b1, disabling compactions & flushes 2023-02-15 02:01:29,849 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:29,850 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:29,850 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. after waiting 0 ms 2023-02-15 02:01:29,850 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:29,850 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:29,850 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:29,853 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => b14b46dcc8ed883a9dc0a363eb2df673, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing c2e8ff8107d18ee12b50850f53173aba, disabling compactions & flushes 2023-02-15 02:01:29,853 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:29,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:29,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. after waiting 0 ms 2023-02-15 02:01:29,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:29,853 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:29,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:29,854 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => e24ce8d2eb57c4f8d22dbffa7665f95e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,867 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,867 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 1be257d4bd696b7b69f1320aaa2d987f, disabling compactions & flushes 2023-02-15 02:01:29,867 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:29,867 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:29,867 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. after waiting 0 ms 2023-02-15 02:01:29,867 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:29,867 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:29,867 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:29,868 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 75238d3fd78336e644d30e29bd798271, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing e24ce8d2eb57c4f8d22dbffa7665f95e, disabling compactions & flushes 2023-02-15 02:01:29,877 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:29,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:29,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. after waiting 0 ms 2023-02-15 02:01:29,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:29,877 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:29,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:29,878 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f3b13c592255d00da395e0f7b7fa7cc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing b14b46dcc8ed883a9dc0a363eb2df673, disabling compactions & flushes 2023-02-15 02:01:29,881 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:29,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:29,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. after waiting 0 ms 2023-02-15 02:01:29,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:29,881 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:29,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:29,882 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => f4c354cd670dfe2d438e4ada1cb4ddde, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,893 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,893 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3f3b13c592255d00da395e0f7b7fa7cc, disabling compactions & flushes 2023-02-15 02:01:29,893 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:29,893 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:29,893 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. after waiting 0 ms 2023-02-15 02:01:29,893 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:29,893 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:29,893 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:29,894 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b3df5f565d6176ba85dc433dd443a1b5, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp 2023-02-15 02:01:29,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:29,904 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,904 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing f4c354cd670dfe2d438e4ada1cb4ddde, disabling compactions & flushes 2023-02-15 02:01:29,904 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:29,904 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:29,904 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. after waiting 0 ms 2023-02-15 02:01:29,904 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:29,904 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:29,904 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:29,909 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:29,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b3df5f565d6176ba85dc433dd443a1b5, disabling compactions & flushes 2023-02-15 02:01:29,910 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:29,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:29,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. after waiting 0 ms 2023-02-15 02:01:29,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:29,910 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:29,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:29,949 INFO [RS:1;jenkins-hbase20:34457] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34457%2C1676426488650, suffix=, logDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34457,1676426488650, archiveDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/oldWALs, maxLogs=32 2023-02-15 02:01:29,963 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK] 2023-02-15 02:01:29,963 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK] 2023-02-15 02:01:29,965 INFO [RS:1;jenkins-hbase20:34457] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/WALs/jenkins-hbase20.apache.org,34457,1676426488650/jenkins-hbase20.apache.org%2C34457%2C1676426488650.1676426489949 2023-02-15 02:01:29,967 DEBUG [RS:1;jenkins-hbase20:34457] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35625,DS-a1b5eae6-aea5-423a-b64c-31a139c3ef76,DISK], DatanodeInfoWithStorage[127.0.0.1:38031,DS-52378add-6753-4273-9fcf-459858976100,DISK]] 2023-02-15 02:01:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:30,285 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,285 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 75238d3fd78336e644d30e29bd798271, disabling compactions & flushes 2023-02-15 02:01:30,285 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,285 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,285 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. after waiting 0 ms 2023-02-15 02:01:30,285 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,285 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,285 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:30,288 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676426489791.75238d3fd78336e644d30e29bd798271.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426490289"}]},"ts":"1676426490289"} 2023-02-15 02:01:30,291 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 02:01:30,292 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:30,292 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426490292"}]},"ts":"1676426490292"} 2023-02-15 02:01:30,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-15 02:01:30,296 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:30,301 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:30,301 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:30,301 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:30,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, ASSIGN}] 2023-02-15 02:01:30,303 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, ASSIGN 2023-02-15 02:01:30,304 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, ASSIGN 2023-02-15 02:01:30,304 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, ASSIGN 2023-02-15 02:01:30,304 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, ASSIGN 2023-02-15 02:01:30,304 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34749,1676426488621; forceNewPlan=false, retain=false 2023-02-15 02:01:30,304 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34749,1676426488621; forceNewPlan=false, retain=false 2023-02-15 02:01:30,305 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34457,1676426488650; forceNewPlan=false, retain=false 2023-02-15 02:01:30,305 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34749,1676426488621; forceNewPlan=false, retain=false 2023-02-15 02:01:30,305 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, ASSIGN 2023-02-15 02:01:30,305 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, ASSIGN 2023-02-15 02:01:30,305 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, ASSIGN 2023-02-15 02:01:30,305 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, ASSIGN 2023-02-15 02:01:30,305 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34749,1676426488621; forceNewPlan=false, retain=false 2023-02-15 02:01:30,305 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, ASSIGN 2023-02-15 02:01:30,305 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34457,1676426488650; forceNewPlan=false, retain=false 2023-02-15 02:01:30,305 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34749,1676426488621; forceNewPlan=false, retain=false 2023-02-15 02:01:30,306 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34457,1676426488650; forceNewPlan=false, retain=false 2023-02-15 02:01:30,306 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, ASSIGN 2023-02-15 02:01:30,306 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34457,1676426488650; forceNewPlan=false, retain=false 2023-02-15 02:01:30,307 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34457,1676426488650; forceNewPlan=false, retain=false 2023-02-15 02:01:30,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:30,455 INFO [jenkins-hbase20:45319] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 02:01:30,461 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3f3b13c592255d00da395e0f7b7fa7cc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e24ce8d2eb57c4f8d22dbffa7665f95e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,461 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b3df5f565d6176ba85dc433dd443a1b5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,461 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490461"}]},"ts":"1676426490461"} 2023-02-15 02:01:30,461 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426490461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490461"}]},"ts":"1676426490461"} 2023-02-15 02:01:30,461 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c2e8ff8107d18ee12b50850f53173aba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,461 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=bfd21ba6382c10b165575af177deeb8a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,462 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426490461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490461"}]},"ts":"1676426490461"} 2023-02-15 02:01:30,461 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490461"}]},"ts":"1676426490461"} 2023-02-15 02:01:30,462 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490461"}]},"ts":"1676426490461"} 2023-02-15 02:01:30,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure b3df5f565d6176ba85dc433dd443a1b5, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:30,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure e24ce8d2eb57c4f8d22dbffa7665f95e, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:30,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure c2e8ff8107d18ee12b50850f53173aba, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:30,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure 3f3b13c592255d00da395e0f7b7fa7cc, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:30,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=67a90a7a933c0f9bbf2b1ecec93241b1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure bfd21ba6382c10b165575af177deeb8a, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:30,466 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490465"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490465"}]},"ts":"1676426490465"} 2023-02-15 02:01:30,466 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f4c354cd670dfe2d438e4ada1cb4ddde, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490466"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490466"}]},"ts":"1676426490466"} 2023-02-15 02:01:30,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 67a90a7a933c0f9bbf2b1ecec93241b1, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:30,469 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=75238d3fd78336e644d30e29bd798271, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1be257d4bd696b7b69f1320aaa2d987f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,469 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676426489791.75238d3fd78336e644d30e29bd798271.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490469"}]},"ts":"1676426490469"} 2023-02-15 02:01:30,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490469"}]},"ts":"1676426490469"} 2023-02-15 02:01:30,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure f4c354cd670dfe2d438e4ada1cb4ddde, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:30,470 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b14b46dcc8ed883a9dc0a363eb2df673, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,470 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490470"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426490470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426490470"}]},"ts":"1676426490470"} 2023-02-15 02:01:30,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 75238d3fd78336e644d30e29bd798271, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:30,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 1be257d4bd696b7b69f1320aaa2d987f, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:30,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure b14b46dcc8ed883a9dc0a363eb2df673, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:30,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:30,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bfd21ba6382c10b165575af177deeb8a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 02:01:30,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,619 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,620 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1 2023-02-15 02:01:30,620 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1 2023-02-15 02:01:30,621 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,621 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfd21ba6382c10b165575af177deeb8a columnFamilyName f1 2023-02-15 02:01:30,621 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:30,621 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(310): Store=bfd21ba6382c10b165575af177deeb8a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,621 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,622 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:30,622 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2 2023-02-15 02:01:30,622 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2 2023-02-15 02:01:30,623 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfd21ba6382c10b165575af177deeb8a columnFamilyName f2 2023-02-15 02:01:30,623 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(310): Store=bfd21ba6382c10b165575af177deeb8a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:30,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 67a90a7a933c0f9bbf2b1ecec93241b1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 02:01:30,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,626 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,627 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1 2023-02-15 02:01:30,627 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1 2023-02-15 02:01:30,627 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a90a7a933c0f9bbf2b1ecec93241b1 columnFamilyName f1 2023-02-15 02:01:30,628 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(310): Store=67a90a7a933c0f9bbf2b1ecec93241b1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,628 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,629 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2 2023-02-15 02:01:30,629 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2 2023-02-15 02:01:30,629 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a90a7a933c0f9bbf2b1ecec93241b1 columnFamilyName f2 2023-02-15 02:01:30,629 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(310): Store=67a90a7a933c0f9bbf2b1ecec93241b1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:30,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 67a90a7a933c0f9bbf2b1ecec93241b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63397061, jitterRate=-0.05531017482280731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:30,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1., pid=26, masterSystemTime=1676426490621 2023-02-15 02:01:30,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:30,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:30,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:30,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=67a90a7a933c0f9bbf2b1ecec93241b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 75238d3fd78336e644d30e29bd798271, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 02:01:30,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490639"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490639"}]},"ts":"1676426490639"} 2023-02-15 02:01:30,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened bfd21ba6382c10b165575af177deeb8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63396126, jitterRate=-0.05532410740852356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,640 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:30,641 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1 2023-02-15 02:01:30,641 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1 2023-02-15 02:01:30,642 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75238d3fd78336e644d30e29bd798271 columnFamilyName f1 2023-02-15 02:01:30,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a., pid=25, masterSystemTime=1676426490614 2023-02-15 02:01:30,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:30,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:30,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:30,644 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=bfd21ba6382c10b165575af177deeb8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f3b13c592255d00da395e0f7b7fa7cc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 02:01:30,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-15 02:01:30,644 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490644"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490644"}]},"ts":"1676426490644"} 2023-02-15 02:01:30,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 67a90a7a933c0f9bbf2b1ecec93241b1, server=jenkins-hbase20.apache.org,34457,1676426488650 in 176 msec 2023-02-15 02:01:30,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, ASSIGN in 343 msec 2023-02-15 02:01:30,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-15 02:01:30,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure bfd21ba6382c10b165575af177deeb8a, server=jenkins-hbase20.apache.org,34749,1676426488621 in 180 msec 2023-02-15 02:01:30,647 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(310): Store=75238d3fd78336e644d30e29bd798271/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,647 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, ASSIGN in 346 msec 2023-02-15 02:01:30,648 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2 2023-02-15 02:01:30,648 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2 2023-02-15 02:01:30,648 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,648 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75238d3fd78336e644d30e29bd798271 columnFamilyName f2 2023-02-15 02:01:30,649 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(310): Store=75238d3fd78336e644d30e29bd798271/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,649 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1 2023-02-15 02:01:30,649 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1 2023-02-15 02:01:30,649 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f3b13c592255d00da395e0f7b7fa7cc columnFamilyName f1 2023-02-15 02:01:30,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,650 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(310): Store=3f3b13c592255d00da395e0f7b7fa7cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,650 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,651 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2 2023-02-15 02:01:30,651 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2 2023-02-15 02:01:30,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,651 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f3b13c592255d00da395e0f7b7fa7cc columnFamilyName f2 2023-02-15 02:01:30,651 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(310): Store=3f3b13c592255d00da395e0f7b7fa7cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:30,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 75238d3fd78336e644d30e29bd798271; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73158221, jitterRate=0.09014244377613068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:30,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271., pid=28, masterSystemTime=1676426490621 2023-02-15 02:01:30,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:30,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 3f3b13c592255d00da395e0f7b7fa7cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70092342, jitterRate=0.04445728659629822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:30,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc., pid=24, masterSystemTime=1676426490614 2023-02-15 02:01:30,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:30,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:30,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f4c354cd670dfe2d438e4ada1cb4ddde, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 02:01:30,657 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=75238d3fd78336e644d30e29bd798271, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,657 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676426489791.75238d3fd78336e644d30e29bd798271.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490657"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490657"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490657"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490657"}]},"ts":"1676426490657"} 2023-02-15 02:01:30,658 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,660 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1 2023-02-15 02:01:30,660 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1 2023-02-15 02:01:30,660 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4c354cd670dfe2d438e4ada1cb4ddde columnFamilyName f1 2023-02-15 02:01:30,660 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(310): Store=f4c354cd670dfe2d438e4ada1cb4ddde/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,660 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,661 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2 2023-02-15 02:01:30,661 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2 2023-02-15 02:01:30,661 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4c354cd670dfe2d438e4ada1cb4ddde columnFamilyName f2 2023-02-15 02:01:30,662 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(310): Store=f4c354cd670dfe2d438e4ada1cb4ddde/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:30,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:30,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:30,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c2e8ff8107d18ee12b50850f53173aba, NAME => 'testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 02:01:30,663 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3f3b13c592255d00da395e0f7b7fa7cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,663 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490663"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490663"}]},"ts":"1676426490663"} 2023-02-15 02:01:30,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-15 02:01:30,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 75238d3fd78336e644d30e29bd798271, server=jenkins-hbase20.apache.org,34457,1676426488650 in 187 msec 2023-02-15 02:01:30,665 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, ASSIGN in 363 msec 2023-02-15 02:01:30,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,666 DEBUG [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f1 2023-02-15 02:01:30,666 DEBUG [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f1 2023-02-15 02:01:30,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:30,666 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-15 02:01:30,666 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure 3f3b13c592255d00da395e0f7b7fa7cc, server=jenkins-hbase20.apache.org,34749,1676426488621 in 200 msec 2023-02-15 02:01:30,666 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e8ff8107d18ee12b50850f53173aba columnFamilyName f1 2023-02-15 02:01:30,667 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(310): Store=c2e8ff8107d18ee12b50850f53173aba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,667 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, ASSIGN in 365 msec 2023-02-15 02:01:30,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,668 DEBUG [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f2 2023-02-15 02:01:30,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f4c354cd670dfe2d438e4ada1cb4ddde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70251284, jitterRate=0.04682570695877075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,668 DEBUG [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f2 2023-02-15 02:01:30,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:30,669 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e8ff8107d18ee12b50850f53173aba columnFamilyName f2 2023-02-15 02:01:30,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde., pid=27, masterSystemTime=1676426490621 2023-02-15 02:01:30,669 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(310): Store=c2e8ff8107d18ee12b50850f53173aba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:30,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:30,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:30,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=f4c354cd670dfe2d438e4ada1cb4ddde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b14b46dcc8ed883a9dc0a363eb2df673, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 02:01:30,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490671"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490671"}]},"ts":"1676426490671"} 2023-02-15 02:01:30,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:30,672 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,673 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1 2023-02-15 02:01:30,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-15 02:01:30,674 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1 2023-02-15 02:01:30,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure f4c354cd670dfe2d438e4ada1cb4ddde, server=jenkins-hbase20.apache.org,34457,1676426488650 in 202 msec 2023-02-15 02:01:30,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,674 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b14b46dcc8ed883a9dc0a363eb2df673 columnFamilyName f1 2023-02-15 02:01:30,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened c2e8ff8107d18ee12b50850f53173aba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61679599, jitterRate=-0.0809023529291153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:30,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, ASSIGN in 373 msec 2023-02-15 02:01:30,675 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(310): Store=b14b46dcc8ed883a9dc0a363eb2df673/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,675 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba., pid=23, masterSystemTime=1676426490614 2023-02-15 02:01:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:30,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:30,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:30,676 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2 2023-02-15 02:01:30,676 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2 2023-02-15 02:01:30,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b3df5f565d6176ba85dc433dd443a1b5, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 02:01:30,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c2e8ff8107d18ee12b50850f53173aba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426490676"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490676"}]},"ts":"1676426490676"} 2023-02-15 02:01:30,677 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b14b46dcc8ed883a9dc0a363eb2df673 columnFamilyName f2 2023-02-15 02:01:30,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,677 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(310): Store=b14b46dcc8ed883a9dc0a363eb2df673/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,678 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-15 02:01:30,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure c2e8ff8107d18ee12b50850f53173aba, server=jenkins-hbase20.apache.org,34749,1676426488621 in 214 msec 2023-02-15 02:01:30,680 DEBUG [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f1 2023-02-15 02:01:30,680 DEBUG [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f1 2023-02-15 02:01:30,681 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3df5f565d6176ba85dc433dd443a1b5 columnFamilyName f1 2023-02-15 02:01:30,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,681 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(310): Store=b3df5f565d6176ba85dc433dd443a1b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, ASSIGN in 379 msec 2023-02-15 02:01:30,681 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:30,682 DEBUG [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f2 2023-02-15 02:01:30,682 DEBUG [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f2 2023-02-15 02:01:30,683 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3df5f565d6176ba85dc433dd443a1b5 columnFamilyName f2 2023-02-15 02:01:30,683 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(310): Store=b3df5f565d6176ba85dc433dd443a1b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b14b46dcc8ed883a9dc0a363eb2df673; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58806094, jitterRate=-0.1237209141254425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:30,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673., pid=30, masterSystemTime=1676426490621 2023-02-15 02:01:30,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:30,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:30,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:30,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b14b46dcc8ed883a9dc0a363eb2df673, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1be257d4bd696b7b69f1320aaa2d987f, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 02:01:30,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490686"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490686"}]},"ts":"1676426490686"} 2023-02-15 02:01:30,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:30,690 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,691 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1 2023-02-15 02:01:30,691 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1 2023-02-15 02:01:30,692 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1be257d4bd696b7b69f1320aaa2d987f columnFamilyName f1 2023-02-15 02:01:30,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-15 02:01:30,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure b14b46dcc8ed883a9dc0a363eb2df673, server=jenkins-hbase20.apache.org,34457,1676426488650 in 217 msec 2023-02-15 02:01:30,692 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(310): Store=1be257d4bd696b7b69f1320aaa2d987f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,692 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b3df5f565d6176ba85dc433dd443a1b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68038143, jitterRate=0.013847336173057556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:30,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, ASSIGN in 391 msec 2023-02-15 02:01:30,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5., pid=21, masterSystemTime=1676426490614 2023-02-15 02:01:30,694 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2 2023-02-15 02:01:30,694 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2 2023-02-15 02:01:30,694 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1be257d4bd696b7b69f1320aaa2d987f columnFamilyName f2 2023-02-15 02:01:30,695 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(310): Store=1be257d4bd696b7b69f1320aaa2d987f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:30,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:30,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:30,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e24ce8d2eb57c4f8d22dbffa7665f95e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 02:01:30,697 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b3df5f565d6176ba85dc433dd443a1b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:30,697 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426490696"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490696"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490696"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490696"}]},"ts":"1676426490696"} 2023-02-15 02:01:30,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,699 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:30,700 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1 2023-02-15 02:01:30,700 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1 2023-02-15 02:01:30,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-15 02:01:30,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure b3df5f565d6176ba85dc433dd443a1b5, server=jenkins-hbase20.apache.org,34749,1676426488621 in 235 msec 2023-02-15 02:01:30,701 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e24ce8d2eb57c4f8d22dbffa7665f95e columnFamilyName f1 2023-02-15 02:01:30,701 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(310): Store=e24ce8d2eb57c4f8d22dbffa7665f95e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,701 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, ASSIGN in 400 msec 2023-02-15 02:01:30,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,703 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2 2023-02-15 02:01:30,703 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2 2023-02-15 02:01:30,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1be257d4bd696b7b69f1320aaa2d987f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64807971, jitterRate=-0.034285977482795715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:30,703 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e24ce8d2eb57c4f8d22dbffa7665f95e columnFamilyName f2 2023-02-15 02:01:30,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f., pid=29, masterSystemTime=1676426490621 2023-02-15 02:01:30,704 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(310): Store=e24ce8d2eb57c4f8d22dbffa7665f95e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:30,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:30,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:30,705 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1be257d4bd696b7b69f1320aaa2d987f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:30,706 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490705"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490705"}]},"ts":"1676426490705"} 2023-02-15 02:01:30,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:30,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:30,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-15 02:01:30,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 1be257d4bd696b7b69f1320aaa2d987f, server=jenkins-hbase20.apache.org,34457,1676426488650 in 236 msec 2023-02-15 02:01:30,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, ASSIGN in 408 msec 2023-02-15 02:01:30,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:30,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e24ce8d2eb57c4f8d22dbffa7665f95e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67565725, jitterRate=0.006807759404182434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:30,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:30,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e., pid=22, masterSystemTime=1676426490614 2023-02-15 02:01:30,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:30,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:30,714 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e24ce8d2eb57c4f8d22dbffa7665f95e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:30,714 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426490714"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426490714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426490714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426490714"}]},"ts":"1676426490714"} 2023-02-15 02:01:30,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-15 02:01:30,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure e24ce8d2eb57c4f8d22dbffa7665f95e, server=jenkins-hbase20.apache.org,34749,1676426488621 in 252 msec 2023-02-15 02:01:30,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-15 02:01:30,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, ASSIGN in 415 msec 2023-02-15 02:01:30,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:30,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426490718"}]},"ts":"1676426490718"} 2023-02-15 02:01:30,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-15 02:01:30,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:30,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 930 msec 2023-02-15 02:01:30,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:30,905 INFO [Listener at localhost.localdomain/39425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-15 02:01:30,905 DEBUG [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-15 02:01:30,906 INFO [Listener at localhost.localdomain/39425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:30,908 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-15 02:01:30,908 INFO [Listener at localhost.localdomain/39425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:30,908 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-15 02:01:30,909 INFO [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:30,949 DEBUG [hconnection-0x6e5f1cc-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:30,963 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:30,965 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:30,970 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34457] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:31,025 INFO [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:31,025 INFO [Listener at localhost.localdomain/39425] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:31,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 02:01:31,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426491026 (current time:1676426491026). 2023-02-15 02:01:31,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:31,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] zookeeper.ReadOnlyZKClient(139): Connect 0x06baf0f8 to 127.0.0.1:64336 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b19e1b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:31,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:31,033 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:31,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06baf0f8 to 127.0.0.1:64336 2023-02-15 02:01:31,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:31,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:31,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 02:01:31,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 02:01:31,037 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 02:01:31,038 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676427091038 2023-02-15 02:01:31,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 02:01:31,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,039 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:31,039 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:31,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 02:01:31,040 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 02:01:31,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-15 02:01:31,042 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 02:01:31,043 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676427091043 2023-02-15 02:01:31,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,057 INFO [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 02:01:31,057 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:31,058 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 02:01:31,058 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 02:01:31,058 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,058 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,059 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:31,059 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:31,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:31,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:31,059 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,059 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,059 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,060 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 02:01:31,060 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 02:01:31,060 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 02:01:31,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,060 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34749,1676426488621' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 02:01:31,065 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34457,1676426488650' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 02:01:31,070 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,070 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:31,071 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,071 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,071 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,071 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:31,071 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,071 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34457,1676426488650' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71497969[Count = 1] remaining members to acquire global barrier 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:31,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34749,1676426488621' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 02:01:31,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71497969[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:31,073 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 02:01:31,073 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,074 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,074 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:31,074 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:31,074 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,074 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:31,074 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:31,074 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:31,074 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. started... 2023-02-15 02:01:31,074 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. started... 2023-02-15 02:01:31,075 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:31,075 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 02:01:31,075 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:31,075 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 02:01:31,076 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:31,076 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:31,075 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:31,075 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. started... 2023-02-15 02:01:31,075 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b14b46dcc8ed883a9dc0a363eb2df673 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:31,075 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bfd21ba6382c10b165575af177deeb8a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 02:01:31,076 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f4c354cd670dfe2d438e4ada1cb4ddde 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 02:01:31,076 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. started... 2023-02-15 02:01:31,076 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:31,076 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. started... 2023-02-15 02:01:31,077 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 75238d3fd78336e644d30e29bd798271 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:31,077 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. started... 2023-02-15 02:01:31,078 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3f3b13c592255d00da395e0f7b7fa7cc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:31,078 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e24ce8d2eb57c4f8d22dbffa7665f95e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:31,128 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f1/3b9b57efe84f47ff8fa04a8245b77ae3 2023-02-15 02:01:31,129 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f1/3ecc70e619b04371b2ed5a4de02c2c65 2023-02-15 02:01:31,139 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:31,140 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f1/2a27ea00039845c4913fce6905ba9e1b 2023-02-15 02:01:31,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 02:01:31,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:31,141 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:31,151 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f1/f1d468429ba048779175c83057fb42be 2023-02-15 02:01:31,161 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f1/ee981a56b7b54276b2fcb692e212a6a9 2023-02-15 02:01:31,178 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f2/4f24b9c8608c419c886c560e689540a6 2023-02-15 02:01:31,187 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f1/3ecc70e619b04371b2ed5a4de02c2c65 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/3ecc70e619b04371b2ed5a4de02c2c65 2023-02-15 02:01:31,192 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/3ecc70e619b04371b2ed5a4de02c2c65, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:31,193 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f2/4f24b9c8608c419c886c560e689540a6 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/4f24b9c8608c419c886c560e689540a6 2023-02-15 02:01:31,195 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f2/cc3a090f5b554ef6bca5595fd41a899d 2023-02-15 02:01:31,197 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/4f24b9c8608c419c886c560e689540a6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:31,198 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for f4c354cd670dfe2d438e4ada1cb4ddde in 122ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,198 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-15 02:01:31,198 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:31,199 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,201 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,201 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/3ecc70e619b04371b2ed5a4de02c2c65] hfiles 2023-02-15 02:01:31,201 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/3ecc70e619b04371b2ed5a4de02c2c65 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,201 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/4f24b9c8608c419c886c560e689540a6] hfiles 2023-02-15 02:01:31,201 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/4f24b9c8608c419c886c560e689540a6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,206 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f1/3b9b57efe84f47ff8fa04a8245b77ae3 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/3b9b57efe84f47ff8fa04a8245b77ae3 2023-02-15 02:01:31,210 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/3b9b57efe84f47ff8fa04a8245b77ae3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,211 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f2/cc3a090f5b554ef6bca5595fd41a899d as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/cc3a090f5b554ef6bca5595fd41a899d 2023-02-15 02:01:31,215 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/cc3a090f5b554ef6bca5595fd41a899d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,215 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3f3b13c592255d00da395e0f7b7fa7cc in 137ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,219 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:31,220 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,234 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f2/627543f6dc904bd29f9a1cfb9fdbc4cc 2023-02-15 02:01:31,234 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f2/29f79352451b471db3e0d65e3ac702fe 2023-02-15 02:01:31,235 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,235 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/3b9b57efe84f47ff8fa04a8245b77ae3] hfiles 2023-02-15 02:01:31,235 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/3b9b57efe84f47ff8fa04a8245b77ae3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,235 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/cc3a090f5b554ef6bca5595fd41a899d] hfiles 2023-02-15 02:01:31,235 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/cc3a090f5b554ef6bca5595fd41a899d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,239 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f2/21c45979d5374be2a1248b5519f7b111 2023-02-15 02:01:31,247 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. completed. 2023-02-15 02:01:31,247 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:31,247 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:31,247 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. started... 2023-02-15 02:01:31,247 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 02:01:31,249 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1be257d4bd696b7b69f1320aaa2d987f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:31,250 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f1/f1d468429ba048779175c83057fb42be as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/f1d468429ba048779175c83057fb42be 2023-02-15 02:01:31,250 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f1/2a27ea00039845c4913fce6905ba9e1b as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/2a27ea00039845c4913fce6905ba9e1b 2023-02-15 02:01:31,250 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f1/ee981a56b7b54276b2fcb692e212a6a9 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/ee981a56b7b54276b2fcb692e212a6a9 2023-02-15 02:01:31,254 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/f1d468429ba048779175c83057fb42be, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,255 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/ee981a56b7b54276b2fcb692e212a6a9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:31,255 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/2a27ea00039845c4913fce6905ba9e1b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,259 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f2/627543f6dc904bd29f9a1cfb9fdbc4cc as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/627543f6dc904bd29f9a1cfb9fdbc4cc 2023-02-15 02:01:31,259 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f2/21c45979d5374be2a1248b5519f7b111 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/21c45979d5374be2a1248b5519f7b111 2023-02-15 02:01:31,259 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f2/29f79352451b471db3e0d65e3ac702fe as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/29f79352451b471db3e0d65e3ac702fe 2023-02-15 02:01:31,265 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/29f79352451b471db3e0d65e3ac702fe, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 02:01:31,266 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for bfd21ba6382c10b165575af177deeb8a in 191ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,266 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:31,266 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,266 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,266 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/ee981a56b7b54276b2fcb692e212a6a9] hfiles 2023-02-15 02:01:31,266 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/ee981a56b7b54276b2fcb692e212a6a9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,267 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/29f79352451b471db3e0d65e3ac702fe] hfiles 2023-02-15 02:01:31,267 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/29f79352451b471db3e0d65e3ac702fe for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,274 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/627543f6dc904bd29f9a1cfb9fdbc4cc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,275 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e24ce8d2eb57c4f8d22dbffa7665f95e in 197ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. completed. 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/f1d468429ba048779175c83057fb42be] hfiles 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. started... 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/f1d468429ba048779175c83057fb42be for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/627543f6dc904bd29f9a1cfb9fdbc4cc] hfiles 2023-02-15 02:01:31,275 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/627543f6dc904bd29f9a1cfb9fdbc4cc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,275 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 02:01:31,277 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:31,277 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,277 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,277 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:31,277 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:31,279 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/21c45979d5374be2a1248b5519f7b111, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,280 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 75238d3fd78336e644d30e29bd798271 in 203ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/2a27ea00039845c4913fce6905ba9e1b] hfiles 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/2a27ea00039845c4913fce6905ba9e1b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/21c45979d5374be2a1248b5519f7b111] hfiles 2023-02-15 02:01:31,280 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/21c45979d5374be2a1248b5519f7b111 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,291 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f1/e560eb0197ea43ec80d34ff40b58eb93 2023-02-15 02:01:31,299 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. completed. 2023-02-15 02:01:31,299 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:31,299 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:31,299 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. started... 2023-02-15 02:01:31,299 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 02:01:31,304 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:31,304 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,304 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,304 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:31,304 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 02:01:31,307 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. completed. 2023-02-15 02:01:31,307 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:31,307 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 02:01:31,317 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. completed. 2023-02-15 02:01:31,318 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:31,318 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 02:01:31,318 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. completed. 2023-02-15 02:01:31,318 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:31,318 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:31,318 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 02:01:31,318 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. started... 2023-02-15 02:01:31,319 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 67a90a7a933c0f9bbf2b1ecec93241b1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 02:01:31,326 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f2/15662e646e6f4cebbe65d812182f34d5 2023-02-15 02:01:31,335 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f1/e560eb0197ea43ec80d34ff40b58eb93 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/e560eb0197ea43ec80d34ff40b58eb93 2023-02-15 02:01:31,340 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. completed. 2023-02-15 02:01:31,340 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:31,340 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 02:01:31,340 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 02:01:31,340 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,340 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 02:01:31,340 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,34749,1676426488621' in zk 2023-02-15 02:01:31,341 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,341 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 02:01:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:31,341 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:31,341 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 02:01:31,341 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:31,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 02:01:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:31,343 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/e560eb0197ea43ec80d34ff40b58eb93, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,343 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 02:01:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:31,343 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f2/15662e646e6f4cebbe65d812182f34d5 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/15662e646e6f4cebbe65d812182f34d5 2023-02-15 02:01:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,34749,1676426488621': 2023-02-15 02:01:31,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34749,1676426488621' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 02:01:31,352 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f1/3ba549706553440ea6b355e0119df675 2023-02-15 02:01:31,355 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/15662e646e6f4cebbe65d812182f34d5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,356 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1be257d4bd696b7b69f1320aaa2d987f in 108ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,356 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:31,356 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,356 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,356 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/e560eb0197ea43ec80d34ff40b58eb93] hfiles 2023-02-15 02:01:31,356 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/e560eb0197ea43ec80d34ff40b58eb93 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,356 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/15662e646e6f4cebbe65d812182f34d5] hfiles 2023-02-15 02:01:31,357 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/15662e646e6f4cebbe65d812182f34d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,369 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. completed. 2023-02-15 02:01:31,369 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:31,369 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 02:01:31,529 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f1/a8ec1e44e04c4b0996a2a0dad3e97299 2023-02-15 02:01:31,541 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f2/9735bee89cc140fca56bbaa2b952d135 2023-02-15 02:01:31,545 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f1/a8ec1e44e04c4b0996a2a0dad3e97299 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/a8ec1e44e04c4b0996a2a0dad3e97299 2023-02-15 02:01:31,550 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/a8ec1e44e04c4b0996a2a0dad3e97299, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,551 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f2/9735bee89cc140fca56bbaa2b952d135 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/9735bee89cc140fca56bbaa2b952d135 2023-02-15 02:01:31,556 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/9735bee89cc140fca56bbaa2b952d135, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,556 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b14b46dcc8ed883a9dc0a363eb2df673 in 481ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/a8ec1e44e04c4b0996a2a0dad3e97299] hfiles 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/a8ec1e44e04c4b0996a2a0dad3e97299 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/9735bee89cc140fca56bbaa2b952d135] hfiles 2023-02-15 02:01:31,557 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/9735bee89cc140fca56bbaa2b952d135 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. completed. 2023-02-15 02:01:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 02:01:31,643 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:31,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 02:01:31,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:31,645 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 02:01:31,776 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f2/9a3eeb15a4e94accb41266a2c569047c 2023-02-15 02:01:31,781 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f1/3ba549706553440ea6b355e0119df675 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/3ba549706553440ea6b355e0119df675 2023-02-15 02:01:31,786 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/3ba549706553440ea6b355e0119df675, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,787 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f2/9a3eeb15a4e94accb41266a2c569047c as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/9a3eeb15a4e94accb41266a2c569047c 2023-02-15 02:01:31,791 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/9a3eeb15a4e94accb41266a2c569047c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 02:01:31,792 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 67a90a7a933c0f9bbf2b1ecec93241b1 in 473ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:31,792 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:31,792 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,792 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:31,793 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/3ba549706553440ea6b355e0119df675] hfiles 2023-02-15 02:01:31,793 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/3ba549706553440ea6b355e0119df675 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,793 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/9a3eeb15a4e94accb41266a2c569047c] hfiles 2023-02-15 02:01:31,793 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/9a3eeb15a4e94accb41266a2c569047c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,804 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. completed. 2023-02-15 02:01:31,805 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:31,805 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 02:01:31,805 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 02:01:31,805 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,805 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 02:01:31,805 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,34457,1676426488650' in zk 2023-02-15 02:01:31,806 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 02:01:31,806 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:31,806 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 02:01:31,806 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:31,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:31,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:31,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:31,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:31,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,34457,1676426488650': 2023-02-15 02:01:31,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34457,1676426488650' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:31,808 INFO [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 02:01:31,808 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:31,808 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:31,808 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,808 INFO [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:31,809 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:31,809 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:31,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:31,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,810 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:31,810 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,811 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,811 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:31,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:31,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion because node does not exist (not an error) 2023-02-15 02:01:31,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:31,814 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,814 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:31,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:31,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:31,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:31,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-15 02:01:31,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,869 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:31,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676426491038Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676426491814 (+776 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676426491814Writing data manifest for testWithMockedMapReduceMultiRegion at 1676426491819 (+5 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676426491835 (+16 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676426491868 (+33 ms) 2023-02-15 02:01:31,871 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 02:01:31,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 832 msec 2023-02-15 02:01:32,145 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:32,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 02:01:32,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:32,146 INFO [Listener at localhost.localdomain/39425] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:32,150 INFO [Listener at localhost.localdomain/39425] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:32,156 INFO [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:32,172 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:32,177 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34457] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,235 INFO [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:32,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:32,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,245 INFO [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 02:01:32,245 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:32,246 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 02:01:32,246 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 02:01:32,246 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,246 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,247 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:32,247 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,247 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:32,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:32,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:32,248 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,248 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,248 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,248 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,251 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 02:01:32,251 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:32,256 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 02:01:32,256 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 02:01:32,256 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:32,256 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. started... 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:32,256 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b14b46dcc8ed883a9dc0a363eb2df673 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:32,257 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 02:01:32,257 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. started... 2023-02-15 02:01:32,256 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 02:01:32,257 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bfd21ba6382c10b165575af177deeb8a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. started... 2023-02-15 02:01:32,257 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:32,257 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f4c354cd670dfe2d438e4ada1cb4ddde 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 02:01:32,257 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:32,257 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. started... 2023-02-15 02:01:32,257 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e24ce8d2eb57c4f8d22dbffa7665f95e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:32,257 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. started... 2023-02-15 02:01:32,256 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:32,257 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. started... 2023-02-15 02:01:32,257 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 75238d3fd78336e644d30e29bd798271 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:32,257 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3f3b13c592255d00da395e0f7b7fa7cc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:32,287 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f1/14d6a0a8401d4559b0e0337bf881b52b 2023-02-15 02:01:32,287 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f1/f8ef075f145a4662b6dd89187469ba5e 2023-02-15 02:01:32,290 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f1/9a3ed222eb93438b88a78e05c4b21e77 2023-02-15 02:01:32,290 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f1/4f9f603df8224101882281de32721ed9 2023-02-15 02:01:32,293 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f1/3680e7b56ef4443590f8bd6c8961dc0b 2023-02-15 02:01:32,293 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f1/015e185512f345f590feb6ad46197d4e 2023-02-15 02:01:32,335 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f2/cac26e9a851d4cc68d5efd3e942076d0 2023-02-15 02:01:32,343 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f2/f4047016cc0d48ba9b6af485a7feb1e7 2023-02-15 02:01:32,347 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f2/ada44b294966429792964664a4e3fd2e 2023-02-15 02:01:32,347 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f2/6dc46ec4967044978e659ca6de322493 2023-02-15 02:01:32,347 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f1/f8ef075f145a4662b6dd89187469ba5e as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/f8ef075f145a4662b6dd89187469ba5e 2023-02-15 02:01:32,350 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f1/4f9f603df8224101882281de32721ed9 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/4f9f603df8224101882281de32721ed9 2023-02-15 02:01:32,350 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f2/6162ff3d51a94f7399df2e3650b2e3c9 2023-02-15 02:01:32,352 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/f8ef075f145a4662b6dd89187469ba5e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:32,352 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f1/14d6a0a8401d4559b0e0337bf881b52b as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/14d6a0a8401d4559b0e0337bf881b52b 2023-02-15 02:01:32,353 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f1/3680e7b56ef4443590f8bd6c8961dc0b as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/3680e7b56ef4443590f8bd6c8961dc0b 2023-02-15 02:01:32,353 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/.tmp/f2/cac26e9a851d4cc68d5efd3e942076d0 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/cac26e9a851d4cc68d5efd3e942076d0 2023-02-15 02:01:32,357 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/4f9f603df8224101882281de32721ed9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:32,358 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/3680e7b56ef4443590f8bd6c8961dc0b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,358 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f1/9a3ed222eb93438b88a78e05c4b21e77 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/9a3ed222eb93438b88a78e05c4b21e77 2023-02-15 02:01:32,358 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/.tmp/f2/f4047016cc0d48ba9b6af485a7feb1e7 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/f4047016cc0d48ba9b6af485a7feb1e7 2023-02-15 02:01:32,358 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/14d6a0a8401d4559b0e0337bf881b52b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,358 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/cac26e9a851d4cc68d5efd3e942076d0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:32,359 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/.tmp/f2/6dc46ec4967044978e659ca6de322493 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/6dc46ec4967044978e659ca6de322493 2023-02-15 02:01:32,359 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/.tmp/f2/ada44b294966429792964664a4e3fd2e as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/ada44b294966429792964664a4e3fd2e 2023-02-15 02:01:32,359 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for f4c354cd670dfe2d438e4ada1cb4ddde in 102ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,359 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:32,359 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:32,360 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:32,360 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 02:01:32,360 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. started... 2023-02-15 02:01:32,360 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1be257d4bd696b7b69f1320aaa2d987f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:32,364 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/9a3ed222eb93438b88a78e05c4b21e77, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,364 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/f4047016cc0d48ba9b6af485a7feb1e7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 02:01:32,364 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/6dc46ec4967044978e659ca6de322493, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,365 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for bfd21ba6382c10b165575af177deeb8a in 107ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/.tmp/f2/6162ff3d51a94f7399df2e3650b2e3c9 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/6162ff3d51a94f7399df2e3650b2e3c9 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:32,365 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 75238d3fd78336e644d30e29bd798271 in 108ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. started... 2023-02-15 02:01:32,365 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. started... 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. started... 2023-02-15 02:01:32,365 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 67a90a7a933c0f9bbf2b1ecec93241b1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:32,365 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:32,365 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/ada44b294966429792964664a4e3fd2e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,366 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e24ce8d2eb57c4f8d22dbffa7665f95e in 109ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,366 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:32,366 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:32,367 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 02:01:32,367 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 02:01:32,367 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 02:01:32,367 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 02:01:32,374 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/6162ff3d51a94f7399df2e3650b2e3c9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,375 INFO [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3f3b13c592255d00da395e0f7b7fa7cc in 118ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,375 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:32,375 DEBUG [rs(jenkins-hbase20.apache.org,34749,1676426488621)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:32,375 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 02:01:32,375 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 02:01:32,375 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,375 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 02:01:32,375 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34749,1676426488621' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 02:01:32,376 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,376 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:32,377 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,377 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:32,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:32,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34749,1676426488621' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 02:01:32,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7576e398[Count = 1] remaining members to acquire global barrier 2023-02-15 02:01:32,379 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f1/531c9a64b67a47f4b5e735d48a188046 2023-02-15 02:01:32,380 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f1/aa4867e2d14845e7a02b313a8d775bb4 2023-02-15 02:01:32,395 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f2/0bad62c66add4fc48d4a913d6fdf3834 2023-02-15 02:01:32,399 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f1/531c9a64b67a47f4b5e735d48a188046 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/531c9a64b67a47f4b5e735d48a188046 2023-02-15 02:01:32,404 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/531c9a64b67a47f4b5e735d48a188046, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,404 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/.tmp/f2/0bad62c66add4fc48d4a913d6fdf3834 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/0bad62c66add4fc48d4a913d6fdf3834 2023-02-15 02:01:32,404 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f2/35c871badf794b3a917d0146c3ff31c8 2023-02-15 02:01:32,408 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/0bad62c66add4fc48d4a913d6fdf3834, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,409 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f1/aa4867e2d14845e7a02b313a8d775bb4 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/aa4867e2d14845e7a02b313a8d775bb4 2023-02-15 02:01:32,409 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 67a90a7a933c0f9bbf2b1ecec93241b1 in 44ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,410 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:32,410 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,410 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 02:01:32,414 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/aa4867e2d14845e7a02b313a8d775bb4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,415 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/.tmp/f2/35c871badf794b3a917d0146c3ff31c8 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/35c871badf794b3a917d0146c3ff31c8 2023-02-15 02:01:32,421 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/35c871badf794b3a917d0146c3ff31c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,422 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1be257d4bd696b7b69f1320aaa2d987f in 62ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,422 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:32,422 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:32,422 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 02:01:32,746 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f2/c34e68b2d24d41dd91933fb5d4e64fe7 2023-02-15 02:01:32,751 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f1/015e185512f345f590feb6ad46197d4e as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/015e185512f345f590feb6ad46197d4e 2023-02-15 02:01:32,755 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/015e185512f345f590feb6ad46197d4e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,756 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/.tmp/f2/c34e68b2d24d41dd91933fb5d4e64fe7 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/c34e68b2d24d41dd91933fb5d4e64fe7 2023-02-15 02:01:32,761 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/c34e68b2d24d41dd91933fb5d4e64fe7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 02:01:32,762 INFO [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b14b46dcc8ed883a9dc0a363eb2df673 in 506ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:32,762 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:32,762 DEBUG [rs(jenkins-hbase20.apache.org,34457,1676426488650)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:32,762 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 02:01:32,762 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 02:01:32,762 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,762 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 02:01:32,762 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34457,1676426488650' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 02:01:32,763 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,763 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:32,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:32,763 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,763 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:32,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:32,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:32,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:32,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34457,1676426488650' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 02:01:32,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7576e398[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:32,765 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 02:01:32,765 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,774 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,774 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,774 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:32,774 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 02:01:32,774 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,34749,1676426488621' in zk 2023-02-15 02:01:32,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,775 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,775 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 02:01:32,775 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 02:01:32,775 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,34457,1676426488650' in zk 2023-02-15 02:01:32,775 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,775 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:32,776 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,776 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 02:01:32,776 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:32,776 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:32,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:32,776 DEBUG [member: 'jenkins-hbase20.apache.org,34749,1676426488621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 02:01:32,776 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 02:01:32,776 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:32,776 DEBUG [member: 'jenkins-hbase20.apache.org,34457,1676426488650' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 02:01:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,34457,1676426488650': 2023-02-15 02:01:32,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34457,1676426488650' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 02:01:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:32,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,34749,1676426488621': 2023-02-15 02:01:32,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34749,1676426488621' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:32,782 INFO [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 02:01:32,782 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:32,782 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:32,782 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,782 INFO [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:32,791 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:32,791 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:32,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:32,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:32,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:32,791 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:32,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:32,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,792 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,793 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,795 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,795 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:32,795 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:32,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:32,796 DEBUG [(jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-15 02:01:32,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:32,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:32,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:32,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:32,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:32,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,796 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:32,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:32,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:32,797 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:32,897 DEBUG [Listener at localhost.localdomain/39425] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:32,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:32,903 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676426491026 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:32,903 DEBUG [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(239): region to add: 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=bfd21ba6382c10b165575af177deeb8a as bfd21ba6382c10b165575af177deeb8a in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=b14b46dcc8ed883a9dc0a363eb2df673 as b14b46dcc8ed883a9dc0a363eb2df673 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=3f3b13c592255d00da395e0f7b7fa7cc as 3f3b13c592255d00da395e0f7b7fa7cc in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=e24ce8d2eb57c4f8d22dbffa7665f95e as e24ce8d2eb57c4f8d22dbffa7665f95e in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=b3df5f565d6176ba85dc433dd443a1b5 as b3df5f565d6176ba85dc433dd443a1b5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=c2e8ff8107d18ee12b50850f53173aba as c2e8ff8107d18ee12b50850f53173aba in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,904 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=f4c354cd670dfe2d438e4ada1cb4ddde as f4c354cd670dfe2d438e4ada1cb4ddde in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,905 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=1be257d4bd696b7b69f1320aaa2d987f as 1be257d4bd696b7b69f1320aaa2d987f in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,905 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=75238d3fd78336e644d30e29bd798271 as 75238d3fd78336e644d30e29bd798271 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,905 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(585): clone region=67a90a7a933c0f9bbf2b1ecec93241b1 as 67a90a7a933c0f9bbf2b1ecec93241b1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,906 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 1be257d4bd696b7b69f1320aaa2d987f, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,906 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => f4c354cd670dfe2d438e4ada1cb4ddde, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,906 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c2e8ff8107d18ee12b50850f53173aba, NAME => 'testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,906 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bfd21ba6382c10b165575af177deeb8a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,906 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e24ce8d2eb57c4f8d22dbffa7665f95e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,907 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3f3b13c592255d00da395e0f7b7fa7cc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,907 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => b14b46dcc8ed883a9dc0a363eb2df673, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,907 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => b3df5f565d6176ba85dc433dd443a1b5, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,936 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,936 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c2e8ff8107d18ee12b50850f53173aba, disabling compactions & flushes 2023-02-15 02:01:32,936 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:32,936 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:32,936 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. after waiting 0 ms 2023-02-15 02:01:32,936 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:32,936 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:32,936 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:32,937 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 75238d3fd78336e644d30e29bd798271, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,947 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,947 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,947 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b9b57efe84f47ff8fa04a8245b77ae3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,947 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a8ec1e44e04c4b0996a2a0dad3e97299 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,960 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9735bee89cc140fca56bbaa2b952d135 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,963 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,963 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing b3df5f565d6176ba85dc433dd443a1b5, disabling compactions & flushes 2023-02-15 02:01:32,963 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:32,963 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:32,963 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. after waiting 0 ms 2023-02-15 02:01:32,963 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:32,963 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:32,963 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:32,964 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 67a90a7a933c0f9bbf2b1ecec93241b1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:32,967 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cc3a090f5b554ef6bca5595fd41a899d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,971 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,971 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e560eb0197ea43ec80d34ff40b58eb93 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,979 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,979 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1d468429ba048779175c83057fb42be from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,979 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,980 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ecc70e619b04371b2ed5a4de02c2c65 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing b14b46dcc8ed883a9dc0a363eb2df673, disabling compactions & flushes 2023-02-15 02:01:32,981 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. after waiting 0 ms 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 3f3b13c592255d00da395e0f7b7fa7cc, disabling compactions & flushes 2023-02-15 02:01:32,981 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 15662e646e6f4cebbe65d812182f34d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,981 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:32,981 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. after waiting 0 ms 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:32,981 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:32,982 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:32,981 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:32,987 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,987 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a27ea00039845c4913fce6905ba9e1b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,988 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f24b9c8608c419c886c560e689540a6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,988 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 627543f6dc904bd29f9a1cfb9fdbc4cc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,989 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 1be257d4bd696b7b69f1320aaa2d987f, disabling compactions & flushes 2023-02-15 02:01:32,989 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:32,989 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:32,989 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. after waiting 0 ms 2023-02-15 02:01:32,989 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:32,989 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:32,989 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:32,990 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 21c45979d5374be2a1248b5519f7b111 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,990 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing f4c354cd670dfe2d438e4ada1cb4ddde, disabling compactions & flushes 2023-02-15 02:01:32,990 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:32,990 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:32,990 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. after waiting 0 ms 2023-02-15 02:01:32,990 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:32,990 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e24ce8d2eb57c4f8d22dbffa7665f95e, disabling compactions & flushes 2023-02-15 02:01:32,990 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:32,991 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:32,991 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:32,991 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:32,991 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. after waiting 0 ms 2023-02-15 02:01:32,991 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:32,991 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:32,991 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:32,992 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 75238d3fd78336e644d30e29bd798271, disabling compactions & flushes 2023-02-15 02:01:32,992 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:32,992 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:32,992 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. after waiting 0 ms 2023-02-15 02:01:32,992 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:32,992 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:32,992 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:32,992 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:32,992 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ba549706553440ea6b355e0119df675 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,994 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a3eeb15a4e94accb41266a2c569047c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:32,996 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 67a90a7a933c0f9bbf2b1ecec93241b1, disabling compactions & flushes 2023-02-15 02:01:32,996 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,996 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,996 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. after waiting 0 ms 2023-02-15 02:01:32,996 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,996 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:32,996 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:33,387 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:33,387 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee981a56b7b54276b2fcb692e212a6a9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:33,389 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 29f79352451b471db3e0d65e3ac702fe from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:33,392 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bfd21ba6382c10b165575af177deeb8a, disabling compactions & flushes 2023-02-15 02:01:33,392 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:33,392 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:33,392 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. after waiting 0 ms 2023-02-15 02:01:33,392 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:33,392 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:33,392 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:33,392 INFO [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676426491026 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:33,392 DEBUG [Listener at localhost.localdomain/39425] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:33,392 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d 2023-02-15 02:01:33,393 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:33,393 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:33,394 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-15 02:01:33,394 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------1be257d4bd696b7b69f1320aaa2d987f/ 2023-02-15 02:01:33,394 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,394 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,395 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1be257d4bd696b7b69f1320aaa2d987f-e560eb0197ea43ec80d34ff40b58eb93 2023-02-15 02:01:33,395 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,395 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1be257d4bd696b7b69f1320aaa2d987f-15662e646e6f4cebbe65d812182f34d5 2023-02-15 02:01:33,395 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------3f3b13c592255d00da395e0f7b7fa7cc/ 2023-02-15 02:01:33,396 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,396 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,396 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3f3b13c592255d00da395e0f7b7fa7cc-3b9b57efe84f47ff8fa04a8245b77ae3 2023-02-15 02:01:33,396 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,396 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3f3b13c592255d00da395e0f7b7fa7cc-cc3a090f5b554ef6bca5595fd41a899d 2023-02-15 02:01:33,396 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------67a90a7a933c0f9bbf2b1ecec93241b1/ 2023-02-15 02:01:33,397 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,397 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,397 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=67a90a7a933c0f9bbf2b1ecec93241b1-3ba549706553440ea6b355e0119df675 2023-02-15 02:01:33,397 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,397 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=67a90a7a933c0f9bbf2b1ecec93241b1-9a3eeb15a4e94accb41266a2c569047c 2023-02-15 02:01:33,397 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------75238d3fd78336e644d30e29bd798271/ 2023-02-15 02:01:33,398 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,398 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,398 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=75238d3fd78336e644d30e29bd798271-2a27ea00039845c4913fce6905ba9e1b 2023-02-15 02:01:33,398 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,398 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=75238d3fd78336e644d30e29bd798271-21c45979d5374be2a1248b5519f7b111 2023-02-15 02:01:33,398 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------b14b46dcc8ed883a9dc0a363eb2df673/ 2023-02-15 02:01:33,399 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,399 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,399 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b14b46dcc8ed883a9dc0a363eb2df673-a8ec1e44e04c4b0996a2a0dad3e97299 2023-02-15 02:01:33,399 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,399 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b14b46dcc8ed883a9dc0a363eb2df673-9735bee89cc140fca56bbaa2b952d135 2023-02-15 02:01:33,399 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------b3df5f565d6176ba85dc433dd443a1b5/ 2023-02-15 02:01:33,400 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,400 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------bfd21ba6382c10b165575af177deeb8a/ 2023-02-15 02:01:33,400 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,400 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,400 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bfd21ba6382c10b165575af177deeb8a-ee981a56b7b54276b2fcb692e212a6a9 2023-02-15 02:01:33,400 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,401 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bfd21ba6382c10b165575af177deeb8a-29f79352451b471db3e0d65e3ac702fe 2023-02-15 02:01:33,401 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------c2e8ff8107d18ee12b50850f53173aba/ 2023-02-15 02:01:33,401 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,401 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------e24ce8d2eb57c4f8d22dbffa7665f95e/ 2023-02-15 02:01:33,401 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,401 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,402 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e24ce8d2eb57c4f8d22dbffa7665f95e-f1d468429ba048779175c83057fb42be 2023-02-15 02:01:33,402 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,402 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e24ce8d2eb57c4f8d22dbffa7665f95e-627543f6dc904bd29f9a1cfb9fdbc4cc 2023-02-15 02:01:33,402 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |----------f4c354cd670dfe2d438e4ada1cb4ddde/ 2023-02-15 02:01:33,402 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:33,402 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:33,403 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f4c354cd670dfe2d438e4ada1cb4ddde-3ecc70e619b04371b2ed5a4de02c2c65 2023-02-15 02:01:33,403 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:33,403 DEBUG [Listener at localhost.localdomain/39425] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f4c354cd670dfe2d438e4ada1cb4ddde-4f24b9c8608c419c886c560e689540a6 2023-02-15 02:01:33,406 INFO [Listener at localhost.localdomain/39425] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 02:01:33,968 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:33,968 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:33,970 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:33,972 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:33,972 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1 2023-02-15 02:01:33,973 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a90a7a933c0f9bbf2b1ecec93241b1 columnFamilyName f1 2023-02-15 02:01:33,976 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/testWithMockedMapReduceMultiRegion=67a90a7a933c0f9bbf2b1ecec93241b1-3ba549706553440ea6b355e0119df675 2023-02-15 02:01:33,976 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(310): Store=67a90a7a933c0f9bbf2b1ecec93241b1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:33,976 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:33,977 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2 2023-02-15 02:01:33,978 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a90a7a933c0f9bbf2b1ecec93241b1 columnFamilyName f2 2023-02-15 02:01:33,981 DEBUG [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/testWithMockedMapReduceMultiRegion=67a90a7a933c0f9bbf2b1ecec93241b1-9a3eeb15a4e94accb41266a2c569047c 2023-02-15 02:01:33,981 INFO [StoreOpener-67a90a7a933c0f9bbf2b1ecec93241b1-1] regionserver.HStore(310): Store=67a90a7a933c0f9bbf2b1ecec93241b1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:33,982 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:33,982 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened 67a90a7a933c0f9bbf2b1ecec93241b1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64736723, jitterRate=-0.03534765541553497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:33,982 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:33,993 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing 67a90a7a933c0f9bbf2b1ecec93241b1, disabling compactions & flushes 2023-02-15 02:01:33,993 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:33,993 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:33,993 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. after waiting 0 ms 2023-02-15 02:01:33,993 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:34,006 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:34,006 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:34,007 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,007 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,011 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,015 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:34,017 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1 2023-02-15 02:01:34,017 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1be257d4bd696b7b69f1320aaa2d987f columnFamilyName f1 2023-02-15 02:01:34,028 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/testWithMockedMapReduceMultiRegion=1be257d4bd696b7b69f1320aaa2d987f-e560eb0197ea43ec80d34ff40b58eb93 2023-02-15 02:01:34,029 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(310): Store=1be257d4bd696b7b69f1320aaa2d987f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,029 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:34,030 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2 2023-02-15 02:01:34,030 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1be257d4bd696b7b69f1320aaa2d987f columnFamilyName f2 2023-02-15 02:01:34,035 DEBUG [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/testWithMockedMapReduceMultiRegion=1be257d4bd696b7b69f1320aaa2d987f-15662e646e6f4cebbe65d812182f34d5 2023-02-15 02:01:34,035 INFO [StoreOpener-1be257d4bd696b7b69f1320aaa2d987f-1] regionserver.HStore(310): Store=1be257d4bd696b7b69f1320aaa2d987f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,035 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,035 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened 1be257d4bd696b7b69f1320aaa2d987f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61590884, jitterRate=-0.08222430944442749}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,035 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:34,047 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing 1be257d4bd696b7b69f1320aaa2d987f, disabling compactions & flushes 2023-02-15 02:01:34,048 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,048 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,048 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. after waiting 0 ms 2023-02-15 02:01:34,048 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,049 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,049 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:34,050 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,050 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,051 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,053 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:34,054 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1 2023-02-15 02:01:34,055 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75238d3fd78336e644d30e29bd798271 columnFamilyName f1 2023-02-15 02:01:34,058 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/testWithMockedMapReduceMultiRegion=75238d3fd78336e644d30e29bd798271-2a27ea00039845c4913fce6905ba9e1b 2023-02-15 02:01:34,059 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(310): Store=75238d3fd78336e644d30e29bd798271/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,059 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:34,060 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2 2023-02-15 02:01:34,060 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75238d3fd78336e644d30e29bd798271 columnFamilyName f2 2023-02-15 02:01:34,063 DEBUG [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/testWithMockedMapReduceMultiRegion=75238d3fd78336e644d30e29bd798271-21c45979d5374be2a1248b5519f7b111 2023-02-15 02:01:34,063 INFO [StoreOpener-75238d3fd78336e644d30e29bd798271-1] regionserver.HStore(310): Store=75238d3fd78336e644d30e29bd798271/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,063 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,064 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened 75238d3fd78336e644d30e29bd798271; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68680166, jitterRate=0.02341422438621521}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,064 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:34,076 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing 75238d3fd78336e644d30e29bd798271, disabling compactions & flushes 2023-02-15 02:01:34,076 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,076 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,077 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. after waiting 0 ms 2023-02-15 02:01:34,077 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,077 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,078 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:34,078 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,078 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,079 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,082 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:34,083 DEBUG [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f1 2023-02-15 02:01:34,084 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3df5f565d6176ba85dc433dd443a1b5 columnFamilyName f1 2023-02-15 02:01:34,084 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(310): Store=b3df5f565d6176ba85dc433dd443a1b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,084 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:34,085 DEBUG [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f2 2023-02-15 02:01:34,085 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3df5f565d6176ba85dc433dd443a1b5 columnFamilyName f2 2023-02-15 02:01:34,086 INFO [StoreOpener-b3df5f565d6176ba85dc433dd443a1b5-1] regionserver.HStore(310): Store=b3df5f565d6176ba85dc433dd443a1b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,086 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,086 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened b3df5f565d6176ba85dc433dd443a1b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70425173, jitterRate=0.04941685497760773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,086 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:34,086 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing b3df5f565d6176ba85dc433dd443a1b5, disabling compactions & flushes 2023-02-15 02:01:34,087 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,087 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,087 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. after waiting 0 ms 2023-02-15 02:01:34,087 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,091 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,091 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:34,091 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,092 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,093 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,095 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:34,096 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1 2023-02-15 02:01:34,096 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfd21ba6382c10b165575af177deeb8a columnFamilyName f1 2023-02-15 02:01:34,101 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/testWithMockedMapReduceMultiRegion=bfd21ba6382c10b165575af177deeb8a-ee981a56b7b54276b2fcb692e212a6a9 2023-02-15 02:01:34,101 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(310): Store=bfd21ba6382c10b165575af177deeb8a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,101 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:34,102 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2 2023-02-15 02:01:34,102 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfd21ba6382c10b165575af177deeb8a columnFamilyName f2 2023-02-15 02:01:34,106 DEBUG [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/testWithMockedMapReduceMultiRegion=bfd21ba6382c10b165575af177deeb8a-29f79352451b471db3e0d65e3ac702fe 2023-02-15 02:01:34,106 INFO [StoreOpener-bfd21ba6382c10b165575af177deeb8a-1] regionserver.HStore(310): Store=bfd21ba6382c10b165575af177deeb8a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,107 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,107 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened bfd21ba6382c10b165575af177deeb8a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74597660, jitterRate=0.11159175634384155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,107 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:34,116 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing bfd21ba6382c10b165575af177deeb8a, disabling compactions & flushes 2023-02-15 02:01:34,116 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,116 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,116 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. after waiting 0 ms 2023-02-15 02:01:34,116 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,117 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,117 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:34,118 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,118 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,119 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,121 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:34,122 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1 2023-02-15 02:01:34,123 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b14b46dcc8ed883a9dc0a363eb2df673 columnFamilyName f1 2023-02-15 02:01:34,126 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/testWithMockedMapReduceMultiRegion=b14b46dcc8ed883a9dc0a363eb2df673-a8ec1e44e04c4b0996a2a0dad3e97299 2023-02-15 02:01:34,127 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(310): Store=b14b46dcc8ed883a9dc0a363eb2df673/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,127 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:34,128 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2 2023-02-15 02:01:34,128 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b14b46dcc8ed883a9dc0a363eb2df673 columnFamilyName f2 2023-02-15 02:01:34,132 DEBUG [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/testWithMockedMapReduceMultiRegion=b14b46dcc8ed883a9dc0a363eb2df673-9735bee89cc140fca56bbaa2b952d135 2023-02-15 02:01:34,132 INFO [StoreOpener-b14b46dcc8ed883a9dc0a363eb2df673-1] regionserver.HStore(310): Store=b14b46dcc8ed883a9dc0a363eb2df673/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,132 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,132 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened b14b46dcc8ed883a9dc0a363eb2df673; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69125985, jitterRate=0.030057445168495178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,132 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:34,141 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing b14b46dcc8ed883a9dc0a363eb2df673, disabling compactions & flushes 2023-02-15 02:01:34,142 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,142 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,142 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. after waiting 0 ms 2023-02-15 02:01:34,142 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,142 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,142 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:34,143 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,143 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,144 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,146 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:34,147 DEBUG [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f1 2023-02-15 02:01:34,148 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e8ff8107d18ee12b50850f53173aba columnFamilyName f1 2023-02-15 02:01:34,148 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(310): Store=c2e8ff8107d18ee12b50850f53173aba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,148 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:34,149 DEBUG [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f2 2023-02-15 02:01:34,149 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e8ff8107d18ee12b50850f53173aba columnFamilyName f2 2023-02-15 02:01:34,150 INFO [StoreOpener-c2e8ff8107d18ee12b50850f53173aba-1] regionserver.HStore(310): Store=c2e8ff8107d18ee12b50850f53173aba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,150 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened c2e8ff8107d18ee12b50850f53173aba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75070842, jitterRate=0.11864271759986877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing c2e8ff8107d18ee12b50850f53173aba, disabling compactions & flushes 2023-02-15 02:01:34,150 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. after waiting 0 ms 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,150 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,150 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:34,151 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,151 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,152 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,154 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:34,155 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1 2023-02-15 02:01:34,155 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4c354cd670dfe2d438e4ada1cb4ddde columnFamilyName f1 2023-02-15 02:01:34,159 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/testWithMockedMapReduceMultiRegion=f4c354cd670dfe2d438e4ada1cb4ddde-3ecc70e619b04371b2ed5a4de02c2c65 2023-02-15 02:01:34,159 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(310): Store=f4c354cd670dfe2d438e4ada1cb4ddde/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,160 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:34,160 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2 2023-02-15 02:01:34,161 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4c354cd670dfe2d438e4ada1cb4ddde columnFamilyName f2 2023-02-15 02:01:34,166 DEBUG [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/testWithMockedMapReduceMultiRegion=f4c354cd670dfe2d438e4ada1cb4ddde-4f24b9c8608c419c886c560e689540a6 2023-02-15 02:01:34,166 INFO [StoreOpener-f4c354cd670dfe2d438e4ada1cb4ddde-1] regionserver.HStore(310): Store=f4c354cd670dfe2d438e4ada1cb4ddde/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,166 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,166 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened f4c354cd670dfe2d438e4ada1cb4ddde; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73868645, jitterRate=0.1007285863161087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,167 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:34,179 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing f4c354cd670dfe2d438e4ada1cb4ddde, disabling compactions & flushes 2023-02-15 02:01:34,179 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,179 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,179 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. after waiting 0 ms 2023-02-15 02:01:34,179 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,225 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,226 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:34,226 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,226 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,228 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,230 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:34,231 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1 2023-02-15 02:01:34,231 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f3b13c592255d00da395e0f7b7fa7cc columnFamilyName f1 2023-02-15 02:01:34,237 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/testWithMockedMapReduceMultiRegion=3f3b13c592255d00da395e0f7b7fa7cc-3b9b57efe84f47ff8fa04a8245b77ae3 2023-02-15 02:01:34,238 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(310): Store=3f3b13c592255d00da395e0f7b7fa7cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,238 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:34,239 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2 2023-02-15 02:01:34,239 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f3b13c592255d00da395e0f7b7fa7cc columnFamilyName f2 2023-02-15 02:01:34,243 DEBUG [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/testWithMockedMapReduceMultiRegion=3f3b13c592255d00da395e0f7b7fa7cc-cc3a090f5b554ef6bca5595fd41a899d 2023-02-15 02:01:34,243 INFO [StoreOpener-3f3b13c592255d00da395e0f7b7fa7cc-1] regionserver.HStore(310): Store=3f3b13c592255d00da395e0f7b7fa7cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,243 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,243 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened 3f3b13c592255d00da395e0f7b7fa7cc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74871243, jitterRate=0.11566846072673798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,243 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:34,251 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing 3f3b13c592255d00da395e0f7b7fa7cc, disabling compactions & flushes 2023-02-15 02:01:34,252 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,252 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,252 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. after waiting 0 ms 2023-02-15 02:01:34,252 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,253 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,253 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:34,253 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:34,253 INFO [Listener at localhost.localdomain/39425] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:34,255 DEBUG [Listener at localhost.localdomain/39425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:34,257 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:34,257 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1 2023-02-15 02:01:34,258 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e24ce8d2eb57c4f8d22dbffa7665f95e columnFamilyName f1 2023-02-15 02:01:34,262 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/testWithMockedMapReduceMultiRegion=e24ce8d2eb57c4f8d22dbffa7665f95e-f1d468429ba048779175c83057fb42be 2023-02-15 02:01:34,262 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(310): Store=e24ce8d2eb57c4f8d22dbffa7665f95e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,262 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:34,263 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2 2023-02-15 02:01:34,263 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e24ce8d2eb57c4f8d22dbffa7665f95e columnFamilyName f2 2023-02-15 02:01:34,267 DEBUG [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36337/user/jenkins/test-data/07227784-623d-639f-988f-29534cc6a48b/testWithMockedMapReduceMultiRegion/d460afd0-9c61-48d4-877b-a2aa235d144d/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/testWithMockedMapReduceMultiRegion=e24ce8d2eb57c4f8d22dbffa7665f95e-627543f6dc904bd29f9a1cfb9fdbc4cc 2023-02-15 02:01:34,267 INFO [StoreOpener-e24ce8d2eb57c4f8d22dbffa7665f95e-1] regionserver.HStore(310): Store=e24ce8d2eb57c4f8d22dbffa7665f95e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:34,267 DEBUG [Listener at localhost.localdomain/39425] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:34,267 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1071): Opened e24ce8d2eb57c4f8d22dbffa7665f95e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59439128, jitterRate=-0.11428797245025635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:34,267 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(964): Region open journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:34,277 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1603): Closing e24ce8d2eb57c4f8d22dbffa7665f95e, disabling compactions & flushes 2023-02-15 02:01:34,277 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,277 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,277 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. after waiting 0 ms 2023-02-15 02:01:34,277 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,278 INFO [Listener at localhost.localdomain/39425] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,278 DEBUG [Listener at localhost.localdomain/39425] regionserver.HRegion(1557): Region close journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:34,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-15 02:01:34,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,293 INFO [Listener at localhost.localdomain/39425] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426494298"}]},"ts":"1676426494298"} 2023-02-15 02:01:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 02:01:34,299 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-15 02:01:34,300 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-15 02:01:34,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, UNASSIGN}] 2023-02-15 02:01:34,302 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, UNASSIGN 2023-02-15 02:01:34,303 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, UNASSIGN 2023-02-15 02:01:34,303 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, UNASSIGN 2023-02-15 02:01:34,304 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, UNASSIGN 2023-02-15 02:01:34,304 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, UNASSIGN 2023-02-15 02:01:34,304 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b3df5f565d6176ba85dc433dd443a1b5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:34,304 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426494304"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494304"}]},"ts":"1676426494304"} 2023-02-15 02:01:34,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e24ce8d2eb57c4f8d22dbffa7665f95e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:34,305 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3f3b13c592255d00da395e0f7b7fa7cc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:34,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494305"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494305"}]},"ts":"1676426494305"} 2023-02-15 02:01:34,305 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=f4c354cd670dfe2d438e4ada1cb4ddde, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=75238d3fd78336e644d30e29bd798271, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,305 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494305"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494305"}]},"ts":"1676426494305"} 2023-02-15 02:01:34,305 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676426489791.75238d3fd78336e644d30e29bd798271.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494305"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494305"}]},"ts":"1676426494305"} 2023-02-15 02:01:34,305 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494305"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494305"}]},"ts":"1676426494305"} 2023-02-15 02:01:34,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure b3df5f565d6176ba85dc433dd443a1b5, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:34,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure e24ce8d2eb57c4f8d22dbffa7665f95e, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:34,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure 3f3b13c592255d00da395e0f7b7fa7cc, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:34,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 75238d3fd78336e644d30e29bd798271, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:34,308 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, UNASSIGN 2023-02-15 02:01:34,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=42, state=RUNNABLE; CloseRegionProcedure f4c354cd670dfe2d438e4ada1cb4ddde, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:34,309 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, UNASSIGN 2023-02-15 02:01:34,309 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b14b46dcc8ed883a9dc0a363eb2df673, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494309"}]},"ts":"1676426494309"} 2023-02-15 02:01:34,310 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, UNASSIGN 2023-02-15 02:01:34,310 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1be257d4bd696b7b69f1320aaa2d987f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,310 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494310"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494310"}]},"ts":"1676426494310"} 2023-02-15 02:01:34,311 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=67a90a7a933c0f9bbf2b1ecec93241b1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,311 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, UNASSIGN 2023-02-15 02:01:34,311 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494311"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494311"}]},"ts":"1676426494311"} 2023-02-15 02:01:34,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure b14b46dcc8ed883a9dc0a363eb2df673, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:34,311 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, UNASSIGN 2023-02-15 02:01:34,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=bfd21ba6382c10b165575af177deeb8a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:34,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 1be257d4bd696b7b69f1320aaa2d987f, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:34,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494312"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494312"}]},"ts":"1676426494312"} 2023-02-15 02:01:34,312 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c2e8ff8107d18ee12b50850f53173aba, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:34,312 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426494312"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426494312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426494312"}]},"ts":"1676426494312"} 2023-02-15 02:01:34,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 67a90a7a933c0f9bbf2b1ecec93241b1, server=jenkins-hbase20.apache.org,34457,1676426488650}] 2023-02-15 02:01:34,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure bfd21ba6382c10b165575af177deeb8a, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:34,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure c2e8ff8107d18ee12b50850f53173aba, server=jenkins-hbase20.apache.org,34749,1676426488621}] 2023-02-15 02:01:34,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 02:01:34,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:34,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e24ce8d2eb57c4f8d22dbffa7665f95e, disabling compactions & flushes 2023-02-15 02:01:34,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. after waiting 0 ms 2023-02-15 02:01:34,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:34,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 75238d3fd78336e644d30e29bd798271, disabling compactions & flushes 2023-02-15 02:01:34,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. after waiting 0 ms 2023-02-15 02:01:34,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e. 2023-02-15 02:01:34,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e24ce8d2eb57c4f8d22dbffa7665f95e: 2023-02-15 02:01:34,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:34,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:34,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing c2e8ff8107d18ee12b50850f53173aba, disabling compactions & flushes 2023-02-15 02:01:34,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. after waiting 0 ms 2023-02-15 02:01:34,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,464 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=e24ce8d2eb57c4f8d22dbffa7665f95e, regionState=CLOSED 2023-02-15 02:01:34,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494463"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494463"}]},"ts":"1676426494463"} 2023-02-15 02:01:34,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271. 2023-02-15 02:01:34,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-15 02:01:34,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 75238d3fd78336e644d30e29bd798271: 2023-02-15 02:01:34,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure e24ce8d2eb57c4f8d22dbffa7665f95e, server=jenkins-hbase20.apache.org,34749,1676426488621 in 158 msec 2023-02-15 02:01:34,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 02:01:34,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba. 2023-02-15 02:01:34,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for c2e8ff8107d18ee12b50850f53173aba: 2023-02-15 02:01:34,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e24ce8d2eb57c4f8d22dbffa7665f95e, UNASSIGN in 165 msec 2023-02-15 02:01:34,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:34,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:34,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f4c354cd670dfe2d438e4ada1cb4ddde, disabling compactions & flushes 2023-02-15 02:01:34,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,480 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=75238d3fd78336e644d30e29bd798271, regionState=CLOSED 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. after waiting 0 ms 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676426489791.75238d3fd78336e644d30e29bd798271.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494480"}]},"ts":"1676426494480"} 2023-02-15 02:01:34,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:34,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 3f3b13c592255d00da395e0f7b7fa7cc, disabling compactions & flushes 2023-02-15 02:01:34,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c2e8ff8107d18ee12b50850f53173aba, regionState=CLOSED 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. after waiting 0 ms 2023-02-15 02:01:34,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426494480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494480"}]},"ts":"1676426494480"} 2023-02-15 02:01:34,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-15 02:01:34,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 75238d3fd78336e644d30e29bd798271, server=jenkins-hbase20.apache.org,34457,1676426488650 in 173 msec 2023-02-15 02:01:34,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-15 02:01:34,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure c2e8ff8107d18ee12b50850f53173aba, server=jenkins-hbase20.apache.org,34749,1676426488621 in 166 msec 2023-02-15 02:01:34,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=75238d3fd78336e644d30e29bd798271, UNASSIGN in 182 msec 2023-02-15 02:01:34,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c2e8ff8107d18ee12b50850f53173aba, UNASSIGN in 182 msec 2023-02-15 02:01:34,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde. 2023-02-15 02:01:34,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f4c354cd670dfe2d438e4ada1cb4ddde: 2023-02-15 02:01:34,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc. 2023-02-15 02:01:34,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 3f3b13c592255d00da395e0f7b7fa7cc: 2023-02-15 02:01:34,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:34,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:34,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1be257d4bd696b7b69f1320aaa2d987f, disabling compactions & flushes 2023-02-15 02:01:34,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,487 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=f4c354cd670dfe2d438e4ada1cb4ddde, regionState=CLOSED 2023-02-15 02:01:34,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. after waiting 0 ms 2023-02-15 02:01:34,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,487 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494487"}]},"ts":"1676426494487"} 2023-02-15 02:01:34,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:34,488 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3f3b13c592255d00da395e0f7b7fa7cc, regionState=CLOSED 2023-02-15 02:01:34,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:34,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494488"}]},"ts":"1676426494488"} 2023-02-15 02:01:34,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b3df5f565d6176ba85dc433dd443a1b5, disabling compactions & flushes 2023-02-15 02:01:34,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. after waiting 0 ms 2023-02-15 02:01:34,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=42 2023-02-15 02:01:34,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=42, state=SUCCESS; CloseRegionProcedure f4c354cd670dfe2d438e4ada1cb4ddde, server=jenkins-hbase20.apache.org,34457,1676426488650 in 180 msec 2023-02-15 02:01:34,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-15 02:01:34,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f4c354cd670dfe2d438e4ada1cb4ddde, UNASSIGN in 188 msec 2023-02-15 02:01:34,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure 3f3b13c592255d00da395e0f7b7fa7cc, server=jenkins-hbase20.apache.org,34749,1676426488621 in 182 msec 2023-02-15 02:01:34,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f3b13c592255d00da395e0f7b7fa7cc, UNASSIGN in 190 msec 2023-02-15 02:01:34,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 02:01:34,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5. 2023-02-15 02:01:34,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b3df5f565d6176ba85dc433dd443a1b5: 2023-02-15 02:01:34,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f. 2023-02-15 02:01:34,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1be257d4bd696b7b69f1320aaa2d987f: 2023-02-15 02:01:34,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:34,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:34,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing bfd21ba6382c10b165575af177deeb8a, disabling compactions & flushes 2023-02-15 02:01:34,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,504 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b3df5f565d6176ba85dc433dd443a1b5, regionState=CLOSED 2023-02-15 02:01:34,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. after waiting 0 ms 2023-02-15 02:01:34,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,504 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676426494504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494504"}]},"ts":"1676426494504"} 2023-02-15 02:01:34,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:34,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:34,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 67a90a7a933c0f9bbf2b1ecec93241b1, disabling compactions & flushes 2023-02-15 02:01:34,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:34,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:34,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. after waiting 0 ms 2023-02-15 02:01:34,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:34,505 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1be257d4bd696b7b69f1320aaa2d987f, regionState=CLOSED 2023-02-15 02:01:34,505 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494505"}]},"ts":"1676426494505"} 2023-02-15 02:01:34,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-15 02:01:34,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure b3df5f565d6176ba85dc433dd443a1b5, server=jenkins-hbase20.apache.org,34749,1676426488621 in 199 msec 2023-02-15 02:01:34,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-15 02:01:34,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b3df5f565d6176ba85dc433dd443a1b5, UNASSIGN in 206 msec 2023-02-15 02:01:34,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 1be257d4bd696b7b69f1320aaa2d987f, server=jenkins-hbase20.apache.org,34457,1676426488650 in 195 msec 2023-02-15 02:01:34,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1be257d4bd696b7b69f1320aaa2d987f, UNASSIGN in 207 msec 2023-02-15 02:01:34,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1. 2023-02-15 02:01:34,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 67a90a7a933c0f9bbf2b1ecec93241b1: 2023-02-15 02:01:34,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a. 2023-02-15 02:01:34,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for bfd21ba6382c10b165575af177deeb8a: 2023-02-15 02:01:34,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:34,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:34,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b14b46dcc8ed883a9dc0a363eb2df673, disabling compactions & flushes 2023-02-15 02:01:34,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,512 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=67a90a7a933c0f9bbf2b1ecec93241b1, regionState=CLOSED 2023-02-15 02:01:34,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. after waiting 0 ms 2023-02-15 02:01:34,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,512 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494512"}]},"ts":"1676426494512"} 2023-02-15 02:01:34,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:34,512 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=bfd21ba6382c10b165575af177deeb8a, regionState=CLOSED 2023-02-15 02:01:34,512 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494512"}]},"ts":"1676426494512"} 2023-02-15 02:01:34,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:34,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-15 02:01:34,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673. 2023-02-15 02:01:34,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b14b46dcc8ed883a9dc0a363eb2df673: 2023-02-15 02:01:34,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 67a90a7a933c0f9bbf2b1ecec93241b1, server=jenkins-hbase20.apache.org,34457,1676426488650 in 202 msec 2023-02-15 02:01:34,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-15 02:01:34,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure bfd21ba6382c10b165575af177deeb8a, server=jenkins-hbase20.apache.org,34749,1676426488621 in 201 msec 2023-02-15 02:01:34,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67a90a7a933c0f9bbf2b1ecec93241b1, UNASSIGN in 215 msec 2023-02-15 02:01:34,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bfd21ba6382c10b165575af177deeb8a, UNASSIGN in 216 msec 2023-02-15 02:01:34,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:34,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b14b46dcc8ed883a9dc0a363eb2df673, regionState=CLOSED 2023-02-15 02:01:34,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676426494518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426494518"}]},"ts":"1676426494518"} 2023-02-15 02:01:34,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-15 02:01:34,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure b14b46dcc8ed883a9dc0a363eb2df673, server=jenkins-hbase20.apache.org,34457,1676426488650 in 208 msec 2023-02-15 02:01:34,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-15 02:01:34,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b14b46dcc8ed883a9dc0a363eb2df673, UNASSIGN in 219 msec 2023-02-15 02:01:34,522 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426494522"}]},"ts":"1676426494522"} 2023-02-15 02:01:34,523 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-15 02:01:34,524 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-15 02:01:34,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 231 msec 2023-02-15 02:01:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 02:01:34,601 INFO [Listener at localhost.localdomain/39425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-15 02:01:34,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,612 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,613 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:34,622 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:34,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/recovered.edits] 2023-02-15 02:01:34,627 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/recovered.edits] 2023-02-15 02:01:34,627 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/recovered.edits] 2023-02-15 02:01:34,628 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/recovered.edits] 2023-02-15 02:01:34,628 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/recovered.edits] 2023-02-15 02:01:34,629 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/recovered.edits] 2023-02-15 02:01:34,629 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/recovered.edits] 2023-02-15 02:01:34,630 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/recovered.edits] 2023-02-15 02:01:34,634 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/2a27ea00039845c4913fce6905ba9e1b to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/2a27ea00039845c4913fce6905ba9e1b 2023-02-15 02:01:34,635 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/aa4867e2d14845e7a02b313a8d775bb4 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/aa4867e2d14845e7a02b313a8d775bb4 2023-02-15 02:01:34,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/3ba549706553440ea6b355e0119df675 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/3ba549706553440ea6b355e0119df675 2023-02-15 02:01:34,636 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/3680e7b56ef4443590f8bd6c8961dc0b to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f1/3680e7b56ef4443590f8bd6c8961dc0b 2023-02-15 02:01:34,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/3b9b57efe84f47ff8fa04a8245b77ae3 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/3b9b57efe84f47ff8fa04a8245b77ae3 2023-02-15 02:01:34,644 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/4f9f603df8224101882281de32721ed9 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/4f9f603df8224101882281de32721ed9 2023-02-15 02:01:34,645 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/015e185512f345f590feb6ad46197d4e to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/015e185512f345f590feb6ad46197d4e 2023-02-15 02:01:34,645 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/14d6a0a8401d4559b0e0337bf881b52b to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/14d6a0a8401d4559b0e0337bf881b52b 2023-02-15 02:01:34,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/531c9a64b67a47f4b5e735d48a188046 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f1/531c9a64b67a47f4b5e735d48a188046 2023-02-15 02:01:34,647 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/e560eb0197ea43ec80d34ff40b58eb93 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f1/e560eb0197ea43ec80d34ff40b58eb93 2023-02-15 02:01:34,648 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/ee981a56b7b54276b2fcb692e212a6a9 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f1/ee981a56b7b54276b2fcb692e212a6a9 2023-02-15 02:01:34,648 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/9a3ed222eb93438b88a78e05c4b21e77 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f1/9a3ed222eb93438b88a78e05c4b21e77 2023-02-15 02:01:34,648 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/recovered.edits/6.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba/recovered.edits/6.seqid 2023-02-15 02:01:34,649 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/a8ec1e44e04c4b0996a2a0dad3e97299 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f1/a8ec1e44e04c4b0996a2a0dad3e97299 2023-02-15 02:01:34,649 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/f1d468429ba048779175c83057fb42be to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f1/f1d468429ba048779175c83057fb42be 2023-02-15 02:01:34,649 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/c2e8ff8107d18ee12b50850f53173aba 2023-02-15 02:01:34,649 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:34,650 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/21c45979d5374be2a1248b5519f7b111 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/21c45979d5374be2a1248b5519f7b111 2023-02-15 02:01:34,652 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/recovered.edits] 2023-02-15 02:01:34,654 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/0bad62c66add4fc48d4a913d6fdf3834 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/0bad62c66add4fc48d4a913d6fdf3834 2023-02-15 02:01:34,654 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/29f79352451b471db3e0d65e3ac702fe to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/29f79352451b471db3e0d65e3ac702fe 2023-02-15 02:01:34,654 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/15662e646e6f4cebbe65d812182f34d5 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/15662e646e6f4cebbe65d812182f34d5 2023-02-15 02:01:34,654 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/6dc46ec4967044978e659ca6de322493 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/f2/6dc46ec4967044978e659ca6de322493 2023-02-15 02:01:34,654 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/6162ff3d51a94f7399df2e3650b2e3c9 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/6162ff3d51a94f7399df2e3650b2e3c9 2023-02-15 02:01:34,654 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/9735bee89cc140fca56bbaa2b952d135 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/9735bee89cc140fca56bbaa2b952d135 2023-02-15 02:01:34,655 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/627543f6dc904bd29f9a1cfb9fdbc4cc to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/627543f6dc904bd29f9a1cfb9fdbc4cc 2023-02-15 02:01:34,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/9a3eeb15a4e94accb41266a2c569047c to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/f2/9a3eeb15a4e94accb41266a2c569047c 2023-02-15 02:01:34,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/35c871badf794b3a917d0146c3ff31c8 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/f2/35c871badf794b3a917d0146c3ff31c8 2023-02-15 02:01:34,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/f4047016cc0d48ba9b6af485a7feb1e7 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/f2/f4047016cc0d48ba9b6af485a7feb1e7 2023-02-15 02:01:34,658 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/c34e68b2d24d41dd91933fb5d4e64fe7 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/f2/c34e68b2d24d41dd91933fb5d4e64fe7 2023-02-15 02:01:34,659 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/cc3a090f5b554ef6bca5595fd41a899d to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/f2/cc3a090f5b554ef6bca5595fd41a899d 2023-02-15 02:01:34,661 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/ada44b294966429792964664a4e3fd2e to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/f2/ada44b294966429792964664a4e3fd2e 2023-02-15 02:01:34,668 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/3ecc70e619b04371b2ed5a4de02c2c65 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/3ecc70e619b04371b2ed5a4de02c2c65 2023-02-15 02:01:34,668 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271/recovered.edits/12.seqid 2023-02-15 02:01:34,668 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f/recovered.edits/12.seqid 2023-02-15 02:01:34,669 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/1be257d4bd696b7b69f1320aaa2d987f 2023-02-15 02:01:34,669 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:34,669 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/75238d3fd78336e644d30e29bd798271 2023-02-15 02:01:34,670 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a/recovered.edits/12.seqid 2023-02-15 02:01:34,670 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc/recovered.edits/12.seqid 2023-02-15 02:01:34,670 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673/recovered.edits/12.seqid 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1/recovered.edits/12.seqid 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f3b13c592255d00da395e0f7b7fa7cc 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/bfd21ba6382c10b165575af177deeb8a 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e/recovered.edits/12.seqid 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/f8ef075f145a4662b6dd89187469ba5e to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f1/f8ef075f145a4662b6dd89187469ba5e 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b14b46dcc8ed883a9dc0a363eb2df673 2023-02-15 02:01:34,671 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/67a90a7a933c0f9bbf2b1ecec93241b1 2023-02-15 02:01:34,672 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/e24ce8d2eb57c4f8d22dbffa7665f95e 2023-02-15 02:01:34,672 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f1, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/f2, FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/recovered.edits] 2023-02-15 02:01:34,674 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/4f24b9c8608c419c886c560e689540a6 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/4f24b9c8608c419c886c560e689540a6 2023-02-15 02:01:34,675 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/cac26e9a851d4cc68d5efd3e942076d0 to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/f2/cac26e9a851d4cc68d5efd3e942076d0 2023-02-15 02:01:34,677 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/recovered.edits/6.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5/recovered.edits/6.seqid 2023-02-15 02:01:34,677 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/b3df5f565d6176ba85dc433dd443a1b5 2023-02-15 02:01:34,677 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/recovered.edits/12.seqid to hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/archive/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde/recovered.edits/12.seqid 2023-02-15 02:01:34,678 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/.tmp/data/default/testWithMockedMapReduceMultiRegion/f4c354cd670dfe2d438e4ada1cb4ddde 2023-02-15 02:01:34,678 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 02:01:34,679 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,682 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-15 02:01:34,684 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,685 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676426489791.75238d3fd78336e644d30e29bd798271.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426494685"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,687 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 02:01:34,687 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c2e8ff8107d18ee12b50850f53173aba, NAME => 'testWithMockedMapReduceMultiRegion,,1676426489791.c2e8ff8107d18ee12b50850f53173aba.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => bfd21ba6382c10b165575af177deeb8a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676426489791.bfd21ba6382c10b165575af177deeb8a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 67a90a7a933c0f9bbf2b1ecec93241b1, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676426489791.67a90a7a933c0f9bbf2b1ecec93241b1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 1be257d4bd696b7b69f1320aaa2d987f, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676426489791.1be257d4bd696b7b69f1320aaa2d987f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => b14b46dcc8ed883a9dc0a363eb2df673, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676426489791.b14b46dcc8ed883a9dc0a363eb2df673.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => e24ce8d2eb57c4f8d22dbffa7665f95e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676426489791.e24ce8d2eb57c4f8d22dbffa7665f95e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 75238d3fd78336e644d30e29bd798271, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676426489791.75238d3fd78336e644d30e29bd798271.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3f3b13c592255d00da395e0f7b7fa7cc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676426489791.3f3b13c592255d00da395e0f7b7fa7cc.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => f4c354cd670dfe2d438e4ada1cb4ddde, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676426489791.f4c354cd670dfe2d438e4ada1cb4ddde.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => b3df5f565d6176ba85dc433dd443a1b5, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676426489791.b3df5f565d6176ba85dc433dd443a1b5.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 02:01:34,687 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-15 02:01:34,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676426494688"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:34,689 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-15 02:01:34,691 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 02:01:34,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 89 msec 2023-02-15 02:01:34,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45319] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 02:01:34,715 INFO [Listener at localhost.localdomain/39425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-15 02:01:34,715 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:34,715 INFO [Listener at localhost.localdomain/39425] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:34,716 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51fb5e26 to 127.0.0.1:64336 2023-02-15 02:01:34,716 DEBUG [Listener at localhost.localdomain/39425] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:34,716 DEBUG [Listener at localhost.localdomain/39425] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:34,716 DEBUG [Listener at localhost.localdomain/39425] util.JVMClusterUtil(257): Found active master hash=307711738, stopped=false 2023-02-15 02:01:34,716 INFO [Listener at localhost.localdomain/39425] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:34,717 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:34,717 INFO [Listener at localhost.localdomain/39425] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:34,717 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:34,717 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:34,717 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:34,718 DEBUG [Listener at localhost.localdomain/39425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ab2bf42 to 127.0.0.1:64336 2023-02-15 02:01:34,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:34,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:34,718 DEBUG [Listener at localhost.localdomain/39425] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:34,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:34,719 INFO [Listener at localhost.localdomain/39425] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34749,1676426488621' ***** 2023-02-15 02:01:34,719 INFO [Listener at localhost.localdomain/39425] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:34,719 INFO [Listener at localhost.localdomain/39425] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34457,1676426488650' ***** 2023-02-15 02:01:34,719 INFO [RS:0;jenkins-hbase20:34749] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:34,719 INFO [Listener at localhost.localdomain/39425] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:34,719 INFO [RS:0;jenkins-hbase20:34749] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:34,719 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:34,719 INFO [RS:0;jenkins-hbase20:34749] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:34,720 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(3304): Received CLOSE for 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:34,720 INFO [RS:1;jenkins-hbase20:34457] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:34,720 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:34,721 INFO [RS:1;jenkins-hbase20:34457] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:34,721 INFO [RS:1;jenkins-hbase20:34457] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:34,721 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,721 DEBUG [RS:1;jenkins-hbase20:34457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77480556 to 127.0.0.1:64336 2023-02-15 02:01:34,721 DEBUG [RS:1;jenkins-hbase20:34457] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:34,721 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34457,1676426488650; all regions closed. 2023-02-15 02:01:34,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7e16a400e453b263e624174295ba0bfd, disabling compactions & flushes 2023-02-15 02:01:34,721 DEBUG [RS:0;jenkins-hbase20:34749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x638dbef5 to 127.0.0.1:64336 2023-02-15 02:01:34,721 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:34,722 DEBUG [RS:0;jenkins-hbase20:34749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:34,722 INFO [RS:0;jenkins-hbase20:34749] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:34,722 INFO [RS:0;jenkins-hbase20:34749] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:34,722 INFO [RS:0;jenkins-hbase20:34749] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:34,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:34,723 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:34,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:34,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. after waiting 0 ms 2023-02-15 02:01:34,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:34,723 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 02:01:34,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 7e16a400e453b263e624174295ba0bfd 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:34,723 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 7e16a400e453b263e624174295ba0bfd=hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd.} 2023-02-15 02:01:34,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:34,725 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1505): Waiting on 1588230740, 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:34,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:34,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:34,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:34,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:34,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.39 KB heapSize=44.49 KB 2023-02-15 02:01:34,725 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:34,732 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:34,734 DEBUG [RS:1;jenkins-hbase20:34457] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/oldWALs 2023-02-15 02:01:34,734 INFO [RS:1;jenkins-hbase20:34457] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34457%2C1676426488650:(num 1676426489949) 2023-02-15 02:01:34,734 DEBUG [RS:1;jenkins-hbase20:34457] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:34,734 INFO [RS:1;jenkins-hbase20:34457] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:34,734 INFO [RS:1;jenkins-hbase20:34457] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:34,734 INFO [RS:1;jenkins-hbase20:34457] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:34,734 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:34,734 INFO [RS:1;jenkins-hbase20:34457] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:34,735 INFO [RS:1;jenkins-hbase20:34457] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:34,736 INFO [RS:1;jenkins-hbase20:34457] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34457 2023-02-15 02:01:34,739 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:34,739 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,739 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34457,1676426488650 2023-02-15 02:01:34,739 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:34,739 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@222f1686 rejected from java.util.concurrent.ThreadPoolExecutor@2610961b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:34,739 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:34,739 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8fab611 rejected from java.util.concurrent.ThreadPoolExecutor@2610961b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:34,740 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34457,1676426488650] 2023-02-15 02:01:34,740 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34457,1676426488650; numProcessing=1 2023-02-15 02:01:34,741 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34457,1676426488650 already deleted, retry=false 2023-02-15 02:01:34,741 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34457,1676426488650 expired; onlineServers=1 2023-02-15 02:01:34,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.76 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/.tmp/info/56796ba221da4bb7a17acc6149fbe6ed 2023-02-15 02:01:34,764 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56796ba221da4bb7a17acc6149fbe6ed 2023-02-15 02:01:34,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/.tmp/rep_barrier/0a98bb5bface46fa856a235bf0c670e9 2023-02-15 02:01:34,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a98bb5bface46fa856a235bf0c670e9 2023-02-15 02:01:34,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/.tmp/table/d787dcdc1cb94bf69db924f671da04ab 2023-02-15 02:01:34,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d787dcdc1cb94bf69db924f671da04ab 2023-02-15 02:01:34,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/.tmp/info/56796ba221da4bb7a17acc6149fbe6ed as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/info/56796ba221da4bb7a17acc6149fbe6ed 2023-02-15 02:01:34,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56796ba221da4bb7a17acc6149fbe6ed 2023-02-15 02:01:34,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/info/56796ba221da4bb7a17acc6149fbe6ed, entries=30, sequenceid=57, filesize=8.3 K 2023-02-15 02:01:34,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/.tmp/rep_barrier/0a98bb5bface46fa856a235bf0c670e9 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/rep_barrier/0a98bb5bface46fa856a235bf0c670e9 2023-02-15 02:01:34,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a98bb5bface46fa856a235bf0c670e9 2023-02-15 02:01:34,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/rep_barrier/0a98bb5bface46fa856a235bf0c670e9, entries=10, sequenceid=57, filesize=6.1 K 2023-02-15 02:01:34,809 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/.tmp/table/d787dcdc1cb94bf69db924f671da04ab as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/table/d787dcdc1cb94bf69db924f671da04ab 2023-02-15 02:01:34,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d787dcdc1cb94bf69db924f671da04ab 2023-02-15 02:01:34,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/table/d787dcdc1cb94bf69db924f671da04ab, entries=13, sequenceid=57, filesize=6.1 K 2023-02-15 02:01:34,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.39 KB/29073, heapSize ~44.45 KB/45512, currentSize=0 B/0 for 1588230740 in 90ms, sequenceid=57, compaction requested=false 2023-02-15 02:01:34,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 02:01:34,827 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:34,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:34,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:34,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:34,917 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:34,917 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7039eebc rejected from java.util.concurrent.ThreadPoolExecutor@2610961b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:34,917 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34457-0x10163ddec8e0002, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:34,917 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e2a87ba rejected from java.util.concurrent.ThreadPoolExecutor@2610961b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:34,917 INFO [RS:1;jenkins-hbase20:34457] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34457,1676426488650; zookeeper connection closed. 2023-02-15 02:01:34,918 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@440d45bd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@440d45bd 2023-02-15 02:01:34,925 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1505): Waiting on 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:34,935 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 02:01:34,935 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 02:01:35,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:35,125 DEBUG [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1505): Waiting on 7e16a400e453b263e624174295ba0bfd 2023-02-15 02:01:35,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/.tmp/info/d7b7f8f61ef7411cb2da6afb9e7886b6 2023-02-15 02:01:35,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/.tmp/info/d7b7f8f61ef7411cb2da6afb9e7886b6 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/info/d7b7f8f61ef7411cb2da6afb9e7886b6 2023-02-15 02:01:35,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/info/d7b7f8f61ef7411cb2da6afb9e7886b6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:35,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7e16a400e453b263e624174295ba0bfd in 448ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:35,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/data/hbase/namespace/7e16a400e453b263e624174295ba0bfd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:35,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:35,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7e16a400e453b263e624174295ba0bfd: 2023-02-15 02:01:35,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426489232.7e16a400e453b263e624174295ba0bfd. 2023-02-15 02:01:35,325 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34749,1676426488621; all regions closed. 2023-02-15 02:01:35,331 DEBUG [RS:0;jenkins-hbase20:34749] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/oldWALs 2023-02-15 02:01:35,331 INFO [RS:0;jenkins-hbase20:34749] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34749%2C1676426488621.meta:.meta(num 1676426489180) 2023-02-15 02:01:35,335 DEBUG [RS:0;jenkins-hbase20:34749] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/oldWALs 2023-02-15 02:01:35,336 INFO [RS:0;jenkins-hbase20:34749] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34749%2C1676426488621:(num 1676426489591) 2023-02-15 02:01:35,336 DEBUG [RS:0;jenkins-hbase20:34749] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:35,336 INFO [RS:0;jenkins-hbase20:34749] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:35,336 INFO [RS:0;jenkins-hbase20:34749] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:35,336 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:35,337 INFO [RS:0;jenkins-hbase20:34749] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34749 2023-02-15 02:01:35,338 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:35,338 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34749,1676426488621 2023-02-15 02:01:35,338 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74fda43 rejected from java.util.concurrent.ThreadPoolExecutor@3705e72[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:35,338 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34749,1676426488621] 2023-02-15 02:01:35,339 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34749,1676426488621; numProcessing=2 2023-02-15 02:01:35,339 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34749,1676426488621 already deleted, retry=false 2023-02-15 02:01:35,339 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34749,1676426488621 expired; onlineServers=0 2023-02-15 02:01:35,339 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,45319,1676426488566' ***** 2023-02-15 02:01:35,339 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:35,340 DEBUG [M:0;jenkins-hbase20:45319] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1668d868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:35,340 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,45319,1676426488566 2023-02-15 02:01:35,340 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,45319,1676426488566; all regions closed. 2023-02-15 02:01:35,340 DEBUG [M:0;jenkins-hbase20:45319] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:35,340 DEBUG [M:0;jenkins-hbase20:45319] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:35,340 DEBUG [M:0;jenkins-hbase20:45319] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:35,340 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:35,340 INFO [M:0;jenkins-hbase20:45319] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:35,341 INFO [M:0;jenkins-hbase20:45319] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:35,340 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426488826] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426488826,5,FailOnTimeoutGroup] 2023-02-15 02:01:35,340 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426488826] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426488826,5,FailOnTimeoutGroup] 2023-02-15 02:01:35,341 INFO [M:0;jenkins-hbase20:45319] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:35,342 DEBUG [M:0;jenkins-hbase20:45319] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:35,342 INFO [M:0;jenkins-hbase20:45319] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:35,342 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:35,342 ERROR [M:0;jenkins-hbase20:45319] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 02:01:35,342 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:35,342 INFO [M:0;jenkins-hbase20:45319] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:35,342 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:35,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:35,343 DEBUG [M:0;jenkins-hbase20:45319] zookeeper.ZKUtil(398): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 02:01:35,343 WARN [M:0;jenkins-hbase20:45319] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 02:01:35,343 INFO [M:0;jenkins-hbase20:45319] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:35,343 INFO [M:0;jenkins-hbase20:45319] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:35,343 DEBUG [M:0;jenkins-hbase20:45319] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:35,343 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:35,343 DEBUG [M:0;jenkins-hbase20:45319] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:35,344 DEBUG [M:0;jenkins-hbase20:45319] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 1 ms 2023-02-15 02:01:35,344 DEBUG [M:0;jenkins-hbase20:45319] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:35,344 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.38 KB heapSize=200.34 KB 2023-02-15 02:01:35,353 INFO [M:0;jenkins-hbase20:45319] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.38 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b04ca9068dfb473ba633e056a90d1088 2023-02-15 02:01:35,356 DEBUG [M:0;jenkins-hbase20:45319] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b04ca9068dfb473ba633e056a90d1088 as hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b04ca9068dfb473ba633e056a90d1088 2023-02-15 02:01:35,360 INFO [M:0;jenkins-hbase20:45319] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36337/user/jenkins/test-data/2a696e9e-3c9b-6d91-dcfc-ec421615d797/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b04ca9068dfb473ba633e056a90d1088, entries=53, sequenceid=357, filesize=10.7 K 2023-02-15 02:01:35,361 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegion(2947): Finished flush of dataSize ~167.38 KB/171396, heapSize ~200.33 KB/205136, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-15 02:01:35,361 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:35,361 DEBUG [M:0;jenkins-hbase20:45319] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:35,364 INFO [M:0;jenkins-hbase20:45319] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:35,364 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:35,364 INFO [M:0;jenkins-hbase20:45319] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45319 2023-02-15 02:01:35,366 DEBUG [M:0;jenkins-hbase20:45319] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,45319,1676426488566 already deleted, retry=false 2023-02-15 02:01:35,439 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:35,439 INFO [RS:0;jenkins-hbase20:34749] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34749,1676426488621; zookeeper connection closed. 2023-02-15 02:01:35,439 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e9add91 rejected from java.util.concurrent.ThreadPoolExecutor@3705e72[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:35,439 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x10163ddec8e0001, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:35,439 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@dd0b26a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@dd0b26a 2023-02-15 02:01:35,439 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@767cc090 rejected from java.util.concurrent.ThreadPoolExecutor@3705e72[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:35,439 INFO [Listener at localhost.localdomain/39425] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:35,539 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:35,539 INFO [M:0;jenkins-hbase20:45319] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,45319,1676426488566; zookeeper connection closed. 2023-02-15 02:01:35,539 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7bf2d5e5 rejected from java.util.concurrent.ThreadPoolExecutor@7fcd5e43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:35,540 DEBUG [Listener at localhost.localdomain/39425-EventThread] zookeeper.ZKWatcher(600): master:45319-0x10163ddec8e0000, quorum=127.0.0.1:64336, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:35,540 WARN [Listener at localhost.localdomain/39425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:35,540 ERROR [Listener at localhost.localdomain/39425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@660fe919 rejected from java.util.concurrent.ThreadPoolExecutor@7fcd5e43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:35,543 INFO [Listener at localhost.localdomain/39425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:35,651 WARN [BP-811320217-148.251.75.209-1676426488080 heartbeating to localhost.localdomain/127.0.0.1:36337] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:35,652 WARN [BP-811320217-148.251.75.209-1676426488080 heartbeating to localhost.localdomain/127.0.0.1:36337] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-811320217-148.251.75.209-1676426488080 (Datanode Uuid e61aa5b6-ec0f-474a-a638-e51a20e35692) service to localhost.localdomain/127.0.0.1:36337 2023-02-15 02:01:35,653 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/dfs/data/data3/current/BP-811320217-148.251.75.209-1676426488080] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:35,653 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/dfs/data/data4/current/BP-811320217-148.251.75.209-1676426488080] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:35,655 WARN [Listener at localhost.localdomain/39425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:35,659 INFO [Listener at localhost.localdomain/39425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:35,764 WARN [BP-811320217-148.251.75.209-1676426488080 heartbeating to localhost.localdomain/127.0.0.1:36337] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:35,766 WARN [BP-811320217-148.251.75.209-1676426488080 heartbeating to localhost.localdomain/127.0.0.1:36337] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-811320217-148.251.75.209-1676426488080 (Datanode Uuid c06d09d4-8dd9-4517-96c2-009054991a86) service to localhost.localdomain/127.0.0.1:36337 2023-02-15 02:01:35,768 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/dfs/data/data1/current/BP-811320217-148.251.75.209-1676426488080] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:35,768 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/cluster_630e5b77-8805-77a4-ff1f-4233ec1bcba2/dfs/data/data2/current/BP-811320217-148.251.75.209-1676426488080] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:35,779 INFO [Listener at localhost.localdomain/39425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:35,896 INFO [Listener at localhost.localdomain/39425] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:35,933 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:35,945 INFO [Listener at localhost.localdomain/39425] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,45319,1676426488566)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36337 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost.localdomain:36337 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36337 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:36337 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39425 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost.localdomain:36337 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36337 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/39425.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36337 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=632 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=270 (was 301), ProcessCount=163 (was 163), AvailableMemoryMB=5624 (was 5696) 2023-02-15 02:01:35,954 INFO [Listener at localhost.localdomain/39425] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=163, AvailableMemoryMB=5624 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/hadoop.log.dir so I do NOT create it in target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812 2023-02-15 02:01:35,964 WARN [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/hadoop.tmp.dir so I do NOT create it in target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812 2023-02-15 02:01:35,964 WARN [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/522d81f3-2c2a-0fbf-f9e3-a43eb1353c44/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 02:01:35,964 DEBUG [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0, deleteOnExit=true 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/test.cache.data in system properties and HBase conf 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:01:35,964 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:01:35,965 DEBUG [Listener at localhost.localdomain/39425] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:35,965 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:35,966 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:01:35,966 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:01:35,966 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:01:35,966 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:35,966 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:01:35,966 INFO [Listener at localhost.localdomain/39425] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:01:35,968 WARN [Listener at localhost.localdomain/39425] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:35,968 WARN [Listener at localhost.localdomain/39425] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:35,992 WARN [Listener at localhost.localdomain/39425] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:35,994 INFO [Listener at localhost.localdomain/39425] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:36,000 INFO [Listener at localhost.localdomain/39425] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/java.io.tmpdir/Jetty_localhost_localdomain_34775_hdfs____ygpsfi/webapp 2023-02-15 02:01:36,073 INFO [Listener at localhost.localdomain/39425] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:34775 2023-02-15 02:01:36,076 WARN [Listener at localhost.localdomain/39425] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:36,076 WARN [Listener at localhost.localdomain/39425] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:36,104 WARN [Listener at localhost.localdomain/40143] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:36,122 WARN [Listener at localhost.localdomain/40143] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:36,124 WARN [Listener at localhost.localdomain/40143] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:36,125 INFO [Listener at localhost.localdomain/40143] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:36,131 INFO [Listener at localhost.localdomain/40143] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/java.io.tmpdir/Jetty_localhost_34909_datanode____.4cwjvc/webapp 2023-02-15 02:01:36,204 INFO [Listener at localhost.localdomain/40143] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34909 2023-02-15 02:01:36,214 WARN [Listener at localhost.localdomain/37051] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:36,234 WARN [Listener at localhost.localdomain/37051] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:36,238 WARN [Listener at localhost.localdomain/37051] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:36,239 INFO [Listener at localhost.localdomain/37051] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:36,244 INFO [Listener at localhost.localdomain/37051] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/java.io.tmpdir/Jetty_localhost_37937_datanode____pypluo/webapp 2023-02-15 02:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x390f878f61db17a8: Processing first storage report for DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae from datanode c0365e00-6768-4eef-8736-27287f810a85 2023-02-15 02:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x390f878f61db17a8: from storage DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae node DatanodeRegistration(127.0.0.1:46237, datanodeUuid=c0365e00-6768-4eef-8736-27287f810a85, infoPort=46763, infoSecurePort=0, ipcPort=37051, storageInfo=lv=-57;cid=testClusterID;nsid=997691793;c=1676426495970), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x390f878f61db17a8: Processing first storage report for DS-7c73c4ed-7066-4e9b-8ef9-67a8dd830365 from datanode c0365e00-6768-4eef-8736-27287f810a85 2023-02-15 02:01:36,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x390f878f61db17a8: from storage DS-7c73c4ed-7066-4e9b-8ef9-67a8dd830365 node DatanodeRegistration(127.0.0.1:46237, datanodeUuid=c0365e00-6768-4eef-8736-27287f810a85, infoPort=46763, infoSecurePort=0, ipcPort=37051, storageInfo=lv=-57;cid=testClusterID;nsid=997691793;c=1676426495970), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:36,328 INFO [Listener at localhost.localdomain/37051] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37937 2023-02-15 02:01:36,337 WARN [Listener at localhost.localdomain/45253] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:36,410 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x68795f3724bd5613: Processing first storage report for DS-89661345-ae90-4ce6-96f0-7832f7f3ba09 from datanode 6ba9ee8e-76c4-4b43-b3d1-d622778e0d93 2023-02-15 02:01:36,410 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x68795f3724bd5613: from storage DS-89661345-ae90-4ce6-96f0-7832f7f3ba09 node DatanodeRegistration(127.0.0.1:45865, datanodeUuid=6ba9ee8e-76c4-4b43-b3d1-d622778e0d93, infoPort=40159, infoSecurePort=0, ipcPort=45253, storageInfo=lv=-57;cid=testClusterID;nsid=997691793;c=1676426495970), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:36,410 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x68795f3724bd5613: Processing first storage report for DS-d9fd60db-69df-41e1-a3e2-3e64da9b3b46 from datanode 6ba9ee8e-76c4-4b43-b3d1-d622778e0d93 2023-02-15 02:01:36,410 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x68795f3724bd5613: from storage DS-d9fd60db-69df-41e1-a3e2-3e64da9b3b46 node DatanodeRegistration(127.0.0.1:45865, datanodeUuid=6ba9ee8e-76c4-4b43-b3d1-d622778e0d93, infoPort=40159, infoSecurePort=0, ipcPort=45253, storageInfo=lv=-57;cid=testClusterID;nsid=997691793;c=1676426495970), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:36,445 DEBUG [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812 2023-02-15 02:01:36,447 INFO [Listener at localhost.localdomain/45253] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/zookeeper_0, clientPort=57378, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:01:36,448 INFO [Listener at localhost.localdomain/45253] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57378 2023-02-15 02:01:36,448 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,449 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,468 INFO [Listener at localhost.localdomain/45253] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257 with version=8 2023-02-15 02:01:36,468 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,469 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,470 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/hbase-staging 2023-02-15 02:01:36,472 INFO [Listener at localhost.localdomain/45253] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:36,473 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,473 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,473 INFO [Listener at localhost.localdomain/45253] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:36,473 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,473 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:36,473 INFO [Listener at localhost.localdomain/45253] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:36,474 INFO [Listener at localhost.localdomain/45253] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43451 2023-02-15 02:01:36,474 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,475 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,476 INFO [Listener at localhost.localdomain/45253] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43451 connecting to ZooKeeper ensemble=127.0.0.1:57378 2023-02-15 02:01:36,491 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:434510x0, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:36,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43451-0x10163de0b6d0000 connected 2023-02-15 02:01:36,514 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:36,514 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:36,515 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:36,515 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43451 2023-02-15 02:01:36,515 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43451 2023-02-15 02:01:36,522 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43451 2023-02-15 02:01:36,523 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43451 2023-02-15 02:01:36,526 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43451 2023-02-15 02:01:36,526 INFO [Listener at localhost.localdomain/45253] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257, hbase.cluster.distributed=false 2023-02-15 02:01:36,536 INFO [Listener at localhost.localdomain/45253] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:36,537 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,537 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,537 INFO [Listener at localhost.localdomain/45253] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:36,537 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,537 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:36,537 INFO [Listener at localhost.localdomain/45253] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:36,539 INFO [Listener at localhost.localdomain/45253] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38715 2023-02-15 02:01:36,539 INFO [Listener at localhost.localdomain/45253] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:36,543 DEBUG [Listener at localhost.localdomain/45253] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:36,543 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,544 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,544 INFO [Listener at localhost.localdomain/45253] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38715 connecting to ZooKeeper ensemble=127.0.0.1:57378 2023-02-15 02:01:36,547 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:387150x0, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:36,549 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): regionserver:387150x0, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:36,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38715-0x10163de0b6d0001 connected 2023-02-15 02:01:36,550 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:36,550 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:36,554 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38715 2023-02-15 02:01:36,554 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38715 2023-02-15 02:01:36,555 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38715 2023-02-15 02:01:36,555 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38715 2023-02-15 02:01:36,556 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38715 2023-02-15 02:01:36,565 INFO [Listener at localhost.localdomain/45253] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:36,565 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,566 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,566 INFO [Listener at localhost.localdomain/45253] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:36,566 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:36,566 INFO [Listener at localhost.localdomain/45253] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:36,566 INFO [Listener at localhost.localdomain/45253] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:36,567 INFO [Listener at localhost.localdomain/45253] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36417 2023-02-15 02:01:36,567 INFO [Listener at localhost.localdomain/45253] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:36,571 DEBUG [Listener at localhost.localdomain/45253] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:36,571 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,572 INFO [Listener at localhost.localdomain/45253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,573 INFO [Listener at localhost.localdomain/45253] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36417 connecting to ZooKeeper ensemble=127.0.0.1:57378 2023-02-15 02:01:36,576 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:364170x0, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:36,577 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): regionserver:364170x0, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:36,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36417-0x10163de0b6d0002 connected 2023-02-15 02:01:36,578 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:36,578 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:36,582 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36417 2023-02-15 02:01:36,582 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36417 2023-02-15 02:01:36,582 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36417 2023-02-15 02:01:36,583 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36417 2023-02-15 02:01:36,583 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36417 2023-02-15 02:01:36,585 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,590 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:36,591 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,591 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:36,591 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:36,591 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:36,591 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:36,593 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:36,594 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,43451,1676426496472 from backup master directory 2023-02-15 02:01:36,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:36,595 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,595 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:36,595 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:36,595 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/hbase.id with ID: faf55135-8625-4ae2-8e0f-e221697041d2 2023-02-15 02:01:36,618 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:36,620 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:36,632 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4933bd38 to 127.0.0.1:57378 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:36,640 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4286be76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:36,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:36,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:01:36,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:36,643 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store-tmp 2023-02-15 02:01:36,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:36,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:36,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:36,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:36,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:36,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:36,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:36,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:36,658 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/WALs/jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,660 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43451%2C1676426496472, suffix=, logDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/WALs/jenkins-hbase20.apache.org,43451,1676426496472, archiveDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/oldWALs, maxLogs=10 2023-02-15 02:01:36,674 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK] 2023-02-15 02:01:36,674 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK] 2023-02-15 02:01:36,678 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/WALs/jenkins-hbase20.apache.org,43451,1676426496472/jenkins-hbase20.apache.org%2C43451%2C1676426496472.1676426496660 2023-02-15 02:01:36,684 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK], DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK]] 2023-02-15 02:01:36,684 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:36,684 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:36,684 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:36,684 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:36,687 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:36,688 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:36,688 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:36,689 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:36,689 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:36,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:36,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:36,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:36,694 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63928371, jitterRate=-0.047393038868904114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:36,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:36,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:36,696 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:36,696 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:36,696 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:36,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 02:01:36,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 02:01:36,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:36,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:36,704 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:36,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:36,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:36,714 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:36,714 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:36,714 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:36,715 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:36,716 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:36,716 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:36,717 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:36,717 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:36,717 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:36,717 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:36,717 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:36,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,43451,1676426496472, sessionid=0x10163de0b6d0000, setting cluster-up flag (Was=false) 2023-02-15 02:01:36,722 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:36,724 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:36,725 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,726 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:36,728 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:36,729 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:36,729 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.hbase-snapshot/.tmp 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:36,731 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,738 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426526738 2023-02-15 02:01:36,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:36,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:36,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:36,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:36,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:36,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:36,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,743 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:36,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:36,744 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:36,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:36,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:36,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:36,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:36,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426496745,5,FailOnTimeoutGroup] 2023-02-15 02:01:36,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426496745,5,FailOnTimeoutGroup] 2023-02-15 02:01:36,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:36,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,745 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,746 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:36,761 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:36,762 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:36,762 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257 2023-02-15 02:01:36,786 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(952): ClusterId : faf55135-8625-4ae2-8e0f-e221697041d2 2023-02-15 02:01:36,786 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(952): ClusterId : faf55135-8625-4ae2-8e0f-e221697041d2 2023-02-15 02:01:36,786 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:36,786 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:36,832 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:36,833 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:36,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/info 2023-02-15 02:01:36,834 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:36,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:36,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:36,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:36,835 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:36,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:36,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:36,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/table 2023-02-15 02:01:36,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:36,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:36,837 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740 2023-02-15 02:01:36,838 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740 2023-02-15 02:01:36,839 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:36,840 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:36,841 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:36,841 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61422964, jitterRate=-0.08472651243209839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:36,841 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:36,841 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:36,841 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:36,842 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:36,842 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:36,842 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:36,842 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:36,842 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:36,843 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:36,843 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:36,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:36,844 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:36,845 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:36,876 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:36,876 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:36,876 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:36,876 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:36,878 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:36,878 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:36,880 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ReadOnlyZKClient(139): Connect 0x01127e21 to 127.0.0.1:57378 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:36,880 DEBUG [RS:1;jenkins-hbase20:36417] zookeeper.ReadOnlyZKClient(139): Connect 0x73a8f4e1 to 127.0.0.1:57378 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:36,888 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fd58073, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:36,888 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bea1551, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:36,891 DEBUG [RS:1;jenkins-hbase20:36417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d6f14e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:36,891 DEBUG [RS:1;jenkins-hbase20:36417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79509f91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:36,897 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38715 2023-02-15 02:01:36,897 INFO [RS:0;jenkins-hbase20:38715] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:36,897 INFO [RS:0;jenkins-hbase20:38715] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:36,897 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:36,897 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,43451,1676426496472 with isa=jenkins-hbase20.apache.org/148.251.75.209:38715, startcode=1676426496536 2023-02-15 02:01:36,898 DEBUG [RS:0;jenkins-hbase20:38715] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:36,899 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:36417 2023-02-15 02:01:36,899 INFO [RS:1;jenkins-hbase20:36417] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:36,899 INFO [RS:1;jenkins-hbase20:36417] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:36,899 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:36,899 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,43451,1676426496472 with isa=jenkins-hbase20.apache.org/148.251.75.209:36417, startcode=1676426496565 2023-02-15 02:01:36,899 DEBUG [RS:1;jenkins-hbase20:36417] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:36,900 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58157, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:36,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:36,904 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52147, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:36,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:36,905 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257 2023-02-15 02:01:36,905 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40143 2023-02-15 02:01:36,906 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:36,907 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:36,907 DEBUG [RS:1;jenkins-hbase20:36417] zookeeper.ZKUtil(162): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:36,907 WARN [RS:1;jenkins-hbase20:36417] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:36,907 INFO [RS:1;jenkins-hbase20:36417] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:36,907 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:36,912 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257 2023-02-15 02:01:36,912 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40143 2023-02-15 02:01:36,912 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:36,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38715,1676426496536] 2023-02-15 02:01:36,916 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ZKUtil(162): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:36,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36417,1676426496565] 2023-02-15 02:01:36,917 WARN [RS:0;jenkins-hbase20:38715] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:36,919 INFO [RS:0;jenkins-hbase20:38715] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:36,920 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:36,934 DEBUG [RS:1;jenkins-hbase20:36417] zookeeper.ZKUtil(162): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:36,935 DEBUG [RS:1;jenkins-hbase20:36417] zookeeper.ZKUtil(162): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:36,935 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ZKUtil(162): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:36,935 DEBUG [RS:1;jenkins-hbase20:36417] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:36,936 INFO [RS:1;jenkins-hbase20:36417] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:36,936 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ZKUtil(162): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:36,936 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:36,937 INFO [RS:0;jenkins-hbase20:38715] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:36,943 INFO [RS:1;jenkins-hbase20:36417] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:36,951 INFO [RS:0;jenkins-hbase20:38715] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:36,951 INFO [RS:1;jenkins-hbase20:36417] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:36,951 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,953 INFO [RS:0;jenkins-hbase20:38715] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:36,953 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:36,954 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,955 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:36,957 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,957 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,957 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,958 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:36,959 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:1;jenkins-hbase20:36417] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:36,959 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,959 DEBUG [RS:0;jenkins-hbase20:38715] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:36,983 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,983 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,983 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:36,995 DEBUG [jenkins-hbase20:43451] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:36,996 DEBUG [jenkins-hbase20:43451] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:36,997 DEBUG [jenkins-hbase20:43451] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:36,997 DEBUG [jenkins-hbase20:43451] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:36,997 DEBUG [jenkins-hbase20:43451] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:37,001 INFO [RS:1;jenkins-hbase20:36417] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:37,001 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36417,1676426496565-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,011 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,011 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,011 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,011 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38715,1676426496536, state=OPENING 2023-02-15 02:01:37,012 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:37,013 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:37,013 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:37,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38715,1676426496536}] 2023-02-15 02:01:37,038 INFO [RS:1;jenkins-hbase20:36417] regionserver.Replication(203): jenkins-hbase20.apache.org,36417,1676426496565 started 2023-02-15 02:01:37,038 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,36417,1676426496565, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36417, sessionid=0x10163de0b6d0002 2023-02-15 02:01:37,038 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:37,038 DEBUG [RS:1;jenkins-hbase20:36417] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:37,038 DEBUG [RS:1;jenkins-hbase20:36417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36417,1676426496565' 2023-02-15 02:01:37,038 DEBUG [RS:1;jenkins-hbase20:36417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:37,039 DEBUG [RS:1;jenkins-hbase20:36417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:37,039 INFO [RS:0;jenkins-hbase20:38715] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:37,039 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38715,1676426496536-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36417,1676426496565' 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:37,040 DEBUG [RS:1;jenkins-hbase20:36417] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:37,040 INFO [RS:1;jenkins-hbase20:36417] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:37,040 INFO [RS:1;jenkins-hbase20:36417] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:37,051 INFO [RS:0;jenkins-hbase20:38715] regionserver.Replication(203): jenkins-hbase20.apache.org,38715,1676426496536 started 2023-02-15 02:01:37,051 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,38715,1676426496536, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38715, sessionid=0x10163de0b6d0001 2023-02-15 02:01:37,051 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:37,051 DEBUG [RS:0;jenkins-hbase20:38715] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:37,051 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38715,1676426496536' 2023-02-15 02:01:37,051 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:37,052 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:37,052 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:37,053 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:37,053 DEBUG [RS:0;jenkins-hbase20:38715] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:37,053 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38715,1676426496536' 2023-02-15 02:01:37,053 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:37,053 DEBUG [RS:0;jenkins-hbase20:38715] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:37,053 DEBUG [RS:0;jenkins-hbase20:38715] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:37,053 INFO [RS:0;jenkins-hbase20:38715] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:37,053 INFO [RS:0;jenkins-hbase20:38715] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:37,175 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:37,176 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:37,177 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57160, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:37,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:37,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:37,182 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38715%2C1676426496536.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,38715,1676426496536, archiveDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/oldWALs, maxLogs=32 2023-02-15 02:01:37,196 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK] 2023-02-15 02:01:37,197 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK] 2023-02-15 02:01:37,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,38715,1676426496536/jenkins-hbase20.apache.org%2C38715%2C1676426496536.meta.1676426497183.meta 2023-02-15 02:01:37,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK], DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK]] 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:37,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:37,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:37,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:37,201 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/info 2023-02-15 02:01:37,201 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/info 2023-02-15 02:01:37,201 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:37,202 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:37,202 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:37,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:37,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:37,202 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:37,203 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:37,203 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:37,204 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/table 2023-02-15 02:01:37,204 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/table 2023-02-15 02:01:37,204 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:37,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:37,205 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740 2023-02-15 02:01:37,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740 2023-02-15 02:01:37,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:37,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:37,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64120303, jitterRate=-0.044533029198646545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:37,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:37,210 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426497175 2023-02-15 02:01:37,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:37,214 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:37,214 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38715,1676426496536, state=OPEN 2023-02-15 02:01:37,215 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:37,215 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:37,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:37,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38715,1676426496536 in 202 msec 2023-02-15 02:01:37,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:37,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 373 msec 2023-02-15 02:01:37,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 488 msec 2023-02-15 02:01:37,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426497219, completionTime=-1 2023-02-15 02:01:37,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:37,219 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:37,222 DEBUG [hconnection-0x22299372-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:37,223 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:37,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:37,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426557225 2023-02-15 02:01:37,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426617225 2023-02-15 02:01:37,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 02:01:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43451,1676426496472-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43451,1676426496472-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43451,1676426496472-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:43451, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:37,247 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:37,247 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:37,249 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:37,249 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:37,249 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:37,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/hbase/namespace/343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/hbase/namespace/343231ae8db26e0c311ea72282b34432 empty. 2023-02-15 02:01:37,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/hbase/namespace/343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:37,261 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:37,262 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 343231ae8db26e0c311ea72282b34432, NAME => 'hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp 2023-02-15 02:01:37,267 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:37,267 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 343231ae8db26e0c311ea72282b34432, disabling compactions & flushes 2023-02-15 02:01:37,267 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,267 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,267 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. after waiting 0 ms 2023-02-15 02:01:37,267 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,267 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,267 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 343231ae8db26e0c311ea72282b34432: 2023-02-15 02:01:37,269 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:37,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426497269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426497269"}]},"ts":"1676426497269"} 2023-02-15 02:01:37,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:37,273 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:37,273 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426497273"}]},"ts":"1676426497273"} 2023-02-15 02:01:37,274 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:37,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:37,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:37,276 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:37,277 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:37,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=343231ae8db26e0c311ea72282b34432, ASSIGN}] 2023-02-15 02:01:37,279 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=343231ae8db26e0c311ea72282b34432, ASSIGN 2023-02-15 02:01:37,281 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=343231ae8db26e0c311ea72282b34432, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38715,1676426496536; forceNewPlan=false, retain=false 2023-02-15 02:01:37,431 INFO [jenkins-hbase20:43451] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:37,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=343231ae8db26e0c311ea72282b34432, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:37,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426497431"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426497431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426497431"}]},"ts":"1676426497431"} 2023-02-15 02:01:37,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 343231ae8db26e0c311ea72282b34432, server=jenkins-hbase20.apache.org,38715,1676426496536}] 2023-02-15 02:01:37,586 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38715%2C1676426496536, suffix=, logDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,38715,1676426496536, archiveDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/oldWALs, maxLogs=32 2023-02-15 02:01:37,601 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK] 2023-02-15 02:01:37,601 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK] 2023-02-15 02:01:37,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,38715,1676426496536/jenkins-hbase20.apache.org%2C38715%2C1676426496536.1676426497587 2023-02-15 02:01:37,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK], DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK]] 2023-02-15 02:01:37,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 343231ae8db26e0c311ea72282b34432, NAME => 'hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:37,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:37,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,604 INFO [StoreOpener-343231ae8db26e0c311ea72282b34432-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,605 DEBUG [StoreOpener-343231ae8db26e0c311ea72282b34432-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/info 2023-02-15 02:01:37,605 DEBUG [StoreOpener-343231ae8db26e0c311ea72282b34432-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/info 2023-02-15 02:01:37,605 INFO [StoreOpener-343231ae8db26e0c311ea72282b34432-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 343231ae8db26e0c311ea72282b34432 columnFamilyName info 2023-02-15 02:01:37,605 INFO [StoreOpener-343231ae8db26e0c311ea72282b34432-1] regionserver.HStore(310): Store=343231ae8db26e0c311ea72282b34432/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:37,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:37,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:37,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 343231ae8db26e0c311ea72282b34432; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67977306, jitterRate=0.012940794229507446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:37,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 343231ae8db26e0c311ea72282b34432: 2023-02-15 02:01:37,611 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432., pid=6, masterSystemTime=1676426497584 2023-02-15 02:01:37,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:37,613 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=343231ae8db26e0c311ea72282b34432, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:37,614 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426497613"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426497613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426497613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426497613"}]},"ts":"1676426497613"} 2023-02-15 02:01:37,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:37,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 343231ae8db26e0c311ea72282b34432, server=jenkins-hbase20.apache.org,38715,1676426496536 in 183 msec 2023-02-15 02:01:37,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:37,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=343231ae8db26e0c311ea72282b34432, ASSIGN in 339 msec 2023-02-15 02:01:37,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:37,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426497618"}]},"ts":"1676426497618"} 2023-02-15 02:01:37,619 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:37,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:37,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 376 msec 2023-02-15 02:01:37,648 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:37,649 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:37,649 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:37,653 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:37,665 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:37,667 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-15 02:01:37,675 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:37,682 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:37,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-15 02:01:37,688 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:37,689 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:37,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.094sec 2023-02-15 02:01:37,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:37,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:37,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:37,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43451,1676426496472-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:37,689 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43451,1676426496472-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:37,695 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:37,787 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ReadOnlyZKClient(139): Connect 0x6a608f34 to 127.0.0.1:57378 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:37,796 DEBUG [Listener at localhost.localdomain/45253] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@314eda0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:37,798 DEBUG [hconnection-0xc1c182e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:37,799 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:37,800 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:37,800 DEBUG [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:37,802 DEBUG [Listener at localhost.localdomain/45253] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:37,804 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32788, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:37,804 INFO [Listener at localhost.localdomain/45253] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 02:01:37,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-15 02:01:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 148.251.75.209:32788 deadline: 1676426557804, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-15 02:01:37,805 INFO [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-15 02:01:37,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:37,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:37,816 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:37,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-15 02:01:37,816 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:37,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:37,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:37,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d empty. 2023-02-15 02:01:37,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:37,818 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 02:01:37,829 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:37,829 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 93ca9ad69f0c8c16c09a22c04c91be9d, NAME => 'testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp 2023-02-15 02:01:37,834 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:37,834 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 93ca9ad69f0c8c16c09a22c04c91be9d, disabling compactions & flushes 2023-02-15 02:01:37,834 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:37,834 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:37,834 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. after waiting 0 ms 2023-02-15 02:01:37,834 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:37,834 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:37,834 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:37,836 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:37,837 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676426497837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426497837"}]},"ts":"1676426497837"} 2023-02-15 02:01:37,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:37,839 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:37,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426497839"}]},"ts":"1676426497839"} 2023-02-15 02:01:37,840 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-15 02:01:37,842 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:37,843 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:37,843 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:37,843 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:37,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, ASSIGN}] 2023-02-15 02:01:37,845 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, ASSIGN 2023-02-15 02:01:37,846 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38715,1676426496536; forceNewPlan=false, retain=false 2023-02-15 02:01:37,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:37,996 INFO [jenkins-hbase20:43451] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:37,996 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=93ca9ad69f0c8c16c09a22c04c91be9d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:37,996 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676426497996"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426497996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426497996"}]},"ts":"1676426497996"} 2023-02-15 02:01:37,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 93ca9ad69f0c8c16c09a22c04c91be9d, server=jenkins-hbase20.apache.org,38715,1676426496536}] 2023-02-15 02:01:38,042 INFO [RS:1;jenkins-hbase20:36417] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36417%2C1676426496565, suffix=, logDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,36417,1676426496565, archiveDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/oldWALs, maxLogs=32 2023-02-15 02:01:38,056 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK] 2023-02-15 02:01:38,056 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK] 2023-02-15 02:01:38,058 INFO [RS:1;jenkins-hbase20:36417] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/WALs/jenkins-hbase20.apache.org,36417,1676426496565/jenkins-hbase20.apache.org%2C36417%2C1676426496565.1676426498042 2023-02-15 02:01:38,058 DEBUG [RS:1;jenkins-hbase20:36417] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46237,DS-0f46b20f-4283-42c5-b9bf-52cd92c086ae,DISK], DatanodeInfoWithStorage[127.0.0.1:45865,DS-89661345-ae90-4ce6-96f0-7832f7f3ba09,DISK]] 2023-02-15 02:01:38,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:38,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93ca9ad69f0c8c16c09a22c04c91be9d, NAME => 'testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,153 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,154 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1 2023-02-15 02:01:38,154 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1 2023-02-15 02:01:38,155 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ca9ad69f0c8c16c09a22c04c91be9d columnFamilyName f1 2023-02-15 02:01:38,155 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(310): Store=93ca9ad69f0c8c16c09a22c04c91be9d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:38,155 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,156 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2 2023-02-15 02:01:38,156 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2 2023-02-15 02:01:38,156 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ca9ad69f0c8c16c09a22c04c91be9d columnFamilyName f2 2023-02-15 02:01:38,156 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(310): Store=93ca9ad69f0c8c16c09a22c04c91be9d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:38,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:38,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:38,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:38,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 93ca9ad69f0c8c16c09a22c04c91be9d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61117872, jitterRate=-0.08927273750305176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:38,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:38,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d., pid=12, masterSystemTime=1676426498150 2023-02-15 02:01:38,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:38,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:38,163 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=93ca9ad69f0c8c16c09a22c04c91be9d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,163 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676426498163"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426498163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426498163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426498163"}]},"ts":"1676426498163"} 2023-02-15 02:01:38,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 02:01:38,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 93ca9ad69f0c8c16c09a22c04c91be9d, server=jenkins-hbase20.apache.org,38715,1676426496536 in 166 msec 2023-02-15 02:01:38,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 02:01:38,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, ASSIGN in 324 msec 2023-02-15 02:01:38,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:38,169 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426498169"}]},"ts":"1676426498169"} 2023-02-15 02:01:38,170 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-15 02:01:38,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:38,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 364 msec 2023-02-15 02:01:38,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:38,421 INFO [Listener at localhost.localdomain/45253] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-15 02:01:38,422 DEBUG [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-15 02:01:38,422 INFO [Listener at localhost.localdomain/45253] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:38,423 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-15 02:01:38,423 INFO [Listener at localhost.localdomain/45253] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:38,424 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-15 02:01:38,424 INFO [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:38,431 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:38,431 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-15 02:01:38,459 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38715] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:38,568 INFO [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:38,568 INFO [Listener at localhost.localdomain/45253] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:38,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 02:01:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426498569 (current time:1676426498569). 2023-02-15 02:01:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:38,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] zookeeper.ReadOnlyZKClient(139): Connect 0x70e58925 to 127.0.0.1:57378 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:38,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12505754, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:38,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:38,574 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:38,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70e58925 to 127.0.0.1:57378 2023-02-15 02:01:38,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:38,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:38,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 02:01:38,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 02:01:38,578 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 02:01:38,579 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676427098579 2023-02-15 02:01:38,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 02:01:38,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,580 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:38,580 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:38,581 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 02:01:38,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 02:01:38,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-15 02:01:38,582 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 02:01:38,582 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676427098582 2023-02-15 02:01:38,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,590 INFO [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 02:01:38,590 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:38,590 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 02:01:38,590 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 02:01:38,591 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,591 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,592 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,592 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:38,592 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:38,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:38,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:38,592 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,592 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,593 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 02:01:38,593 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:38,593 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 02:01:38,594 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 02:01:38,594 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 02:01:38,594 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:38,594 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38715,1676426496536' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 02:01:38,595 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 02:01:38,595 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 02:01:38,595 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36417,1676426496565' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 02:01:38,596 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,596 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:38,596 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:38,596 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,596 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:38,596 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,596 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:38,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38715,1676426496536' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 02:01:38,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e2c5b68[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:38,597 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 02:01:38,597 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 02:01:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 02:01:38,598 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,598 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 02:01:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,36417,1676426496565' in zk 2023-02-15 02:01:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 02:01:38,598 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:38,598 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:38,599 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. started... 2023-02-15 02:01:38,599 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 93ca9ad69f0c8c16c09a22c04c91be9d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 02:01:38,599 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 02:01:38,599 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:38,599 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 02:01:38,614 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f1/904daa3827e84c9db3c204455f32fb61 2023-02-15 02:01:38,630 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f2/4219b67ecaec45e5ab311aa0757c9a29 2023-02-15 02:01:38,634 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f1/904daa3827e84c9db3c204455f32fb61 as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/904daa3827e84c9db3c204455f32fb61 2023-02-15 02:01:38,637 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/904daa3827e84c9db3c204455f32fb61, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:38,637 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f2/4219b67ecaec45e5ab311aa0757c9a29 as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/4219b67ecaec45e5ab311aa0757c9a29 2023-02-15 02:01:38,641 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/4219b67ecaec45e5ab311aa0757c9a29, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:38,641 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 93ca9ad69f0c8c16c09a22c04c91be9d in 42ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:38,641 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/904daa3827e84c9db3c204455f32fb61] hfiles 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/904daa3827e84c9db3c204455f32fb61 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/4219b67ecaec45e5ab311aa0757c9a29] hfiles 2023-02-15 02:01:38,642 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/4219b67ecaec45e5ab311aa0757c9a29 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,647 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. completed. 2023-02-15 02:01:38,647 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:38,647 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 02:01:38,647 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 02:01:38,647 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,647 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 02:01:38,647 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,38715,1676426496536' in zk 2023-02-15 02:01:38,648 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 02:01:38,648 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,648 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:38,648 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 02:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:38,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,38715,1676426496536': 2023-02-15 02:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38715,1676426496536' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:38,651 INFO [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 02:01:38,651 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:38,652 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:38,652 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,652 INFO [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:38,653 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:38,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:38,653 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:38,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:38,653 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,654 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:38,655 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,655 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,666 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,666 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:38,666 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,666 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:38,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,667 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:38,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:38,667 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:38,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:38,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:38,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:38,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:38,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:38,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,681 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:38,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 02:01:38,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:38,683 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:38,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-15 02:01:38,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,710 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:38,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676426498579Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676426498667 (+88 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676426498668 (+1 ms)Writing data manifest for testWithMockedMapReduceSingleRegion at 1676426498671 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676426498681 (+10 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676426498709 (+28 ms) 2023-02-15 02:01:38,712 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 02:01:38,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 132 msec 2023-02-15 02:01:38,883 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:38,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 02:01:38,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:38,884 INFO [Listener at localhost.localdomain/45253] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:38,889 INFO [Listener at localhost.localdomain/45253] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:38,894 INFO [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:38,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38715] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,009 INFO [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:39,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:39,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,018 INFO [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 02:01:39,019 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:39,020 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 02:01:39,020 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 02:01:39,021 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,021 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,022 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:39,022 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:39,022 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:39,022 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,023 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:39,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,024 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,026 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 02:01:39,026 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:39,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,027 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 02:01:39,027 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 02:01:39,027 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36417,1676426496565' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 02:01:39,028 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 02:01:39,028 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:39,028 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 02:01:39,028 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 02:01:39,028 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:39,028 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,028 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. started... 2023-02-15 02:01:39,029 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ca9ad69f0c8c16c09a22c04c91be9d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 02:01:39,040 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,041 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,041 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:39,046 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f1/e44f55e06f724c93bf1ac072b1bed63e 2023-02-15 02:01:39,065 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f2/066f931395f84de8bdfd5799e34ca02f 2023-02-15 02:01:39,070 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f1/e44f55e06f724c93bf1ac072b1bed63e as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/e44f55e06f724c93bf1ac072b1bed63e 2023-02-15 02:01:39,076 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/e44f55e06f724c93bf1ac072b1bed63e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:39,077 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/.tmp/f2/066f931395f84de8bdfd5799e34ca02f as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/066f931395f84de8bdfd5799e34ca02f 2023-02-15 02:01:39,083 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/066f931395f84de8bdfd5799e34ca02f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:39,084 INFO [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 93ca9ad69f0c8c16c09a22c04c91be9d in 55ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:39,085 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:39,085 DEBUG [rs(jenkins-hbase20.apache.org,38715,1676426496536)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,085 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 02:01:39,085 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 02:01:39,085 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,085 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 02:01:39,085 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38715,1676426496536' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 02:01:39,086 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:39,087 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:39,088 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,088 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:39,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38715,1676426496536' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 02:01:39,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a13c675[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:39,089 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 02:01:39,089 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,090 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,090 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,090 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 02:01:39,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,091 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 02:01:39,091 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 02:01:39,091 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,091 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:39,091 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,36417,1676426496565' in zk 2023-02-15 02:01:39,091 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 02:01:39,091 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,38715,1676426496536' in zk 2023-02-15 02:01:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 02:01:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 02:01:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,36417,1676426496565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 02:01:39,092 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,38715,1676426496536' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 02:01:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,38715,1676426496536': 2023-02-15 02:01:39,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38715,1676426496536' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:39,095 INFO [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 02:01:39,095 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:39,095 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:39,095 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,095 INFO [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:39,096 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,096 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,096 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:39,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:39,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:39,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:39,098 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,100 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:39,101 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:39,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:39,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-15 02:01:39,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,104 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,105 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,104 DEBUG [(jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:39,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:39,105 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:39,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:39,105 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:39,105 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:39,105 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:39,105 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:39,206 DEBUG [Listener at localhost.localdomain/45253] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:39,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:39,211 INFO [Listener at localhost.localdomain/45253] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676426498569 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:39,211 DEBUG [Listener at localhost.localdomain/45253] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e/data/default/testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,211 INFO [Listener at localhost.localdomain/45253] snapshot.RestoreSnapshotHelper(239): region to add: 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,211 INFO [Listener at localhost.localdomain/45253] snapshot.RestoreSnapshotHelper(585): clone region=93ca9ad69f0c8c16c09a22c04c91be9d as 93ca9ad69f0c8c16c09a22c04c91be9d in snapshot testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,212 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 93ca9ad69f0c8c16c09a22c04c91be9d, NAME => 'testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e 2023-02-15 02:01:39,219 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:39,219 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 904daa3827e84c9db3c204455f32fb61 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,221 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4219b67ecaec45e5ab311aa0757c9a29 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,222 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 93ca9ad69f0c8c16c09a22c04c91be9d, disabling compactions & flushes 2023-02-15 02:01:39,222 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,222 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,222 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. after waiting 0 ms 2023-02-15 02:01:39,222 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,222 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,222 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:39,222 INFO [Listener at localhost.localdomain/45253] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676426498569 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:39,223 DEBUG [Listener at localhost.localdomain/45253] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e 2023-02-15 02:01:39,223 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e 2023-02-15 02:01:39,223 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:39,223 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:39,224 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-15 02:01:39,225 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(699): |----------93ca9ad69f0c8c16c09a22c04c91be9d/ 2023-02-15 02:01:39,225 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:39,225 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:39,225 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=93ca9ad69f0c8c16c09a22c04c91be9d-904daa3827e84c9db3c204455f32fb61 2023-02-15 02:01:39,226 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:39,226 DEBUG [Listener at localhost.localdomain/45253] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=93ca9ad69f0c8c16c09a22c04c91be9d-4219b67ecaec45e5ab311aa0757c9a29 2023-02-15 02:01:39,229 INFO [Listener at localhost.localdomain/45253] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 02:01:39,232 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:39,232 INFO [Listener at localhost.localdomain/45253] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:39,233 DEBUG [Listener at localhost.localdomain/45253] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:39,235 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,236 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1 2023-02-15 02:01:39,236 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ca9ad69f0c8c16c09a22c04c91be9d columnFamilyName f1 2023-02-15 02:01:39,240 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/testWithMockedMapReduceSingleRegion=93ca9ad69f0c8c16c09a22c04c91be9d-904daa3827e84c9db3c204455f32fb61 2023-02-15 02:01:39,240 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(310): Store=93ca9ad69f0c8c16c09a22c04c91be9d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:39,240 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,241 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2 2023-02-15 02:01:39,241 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ca9ad69f0c8c16c09a22c04c91be9d columnFamilyName f2 2023-02-15 02:01:39,244 DEBUG [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40143/user/jenkins/test-data/be6def2b-b750-cbe5-a684-2f74d8f12702/testWithMockedMapReduceSingleRegion/087f9391-6721-41af-8eb0-aa425fb4116e/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/testWithMockedMapReduceSingleRegion=93ca9ad69f0c8c16c09a22c04c91be9d-4219b67ecaec45e5ab311aa0757c9a29 2023-02-15 02:01:39,244 INFO [StoreOpener-93ca9ad69f0c8c16c09a22c04c91be9d-1] regionserver.HStore(310): Store=93ca9ad69f0c8c16c09a22c04c91be9d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:39,245 DEBUG [Listener at localhost.localdomain/45253] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:39,245 INFO [Listener at localhost.localdomain/45253] regionserver.HRegion(1071): Opened 93ca9ad69f0c8c16c09a22c04c91be9d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70304758, jitterRate=0.04762253165245056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:39,245 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(964): Region open journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:39,289 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(1603): Closing 93ca9ad69f0c8c16c09a22c04c91be9d, disabling compactions & flushes 2023-02-15 02:01:39,289 INFO [Listener at localhost.localdomain/45253] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,290 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,290 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. after waiting 0 ms 2023-02-15 02:01:39,290 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,290 INFO [Listener at localhost.localdomain/45253] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,290 DEBUG [Listener at localhost.localdomain/45253] regionserver.HRegion(1557): Region close journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:39,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-15 02:01:39,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,300 INFO [Listener at localhost.localdomain/45253] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:39,303 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426499303"}]},"ts":"1676426499303"} 2023-02-15 02:01:39,304 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-15 02:01:39,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:39,514 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-15 02:01:39,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, UNASSIGN}] 2023-02-15 02:01:39,516 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, UNASSIGN 2023-02-15 02:01:39,517 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=93ca9ad69f0c8c16c09a22c04c91be9d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:39,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676426499517"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426499517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426499517"}]},"ts":"1676426499517"} 2023-02-15 02:01:39,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 93ca9ad69f0c8c16c09a22c04c91be9d, server=jenkins-hbase20.apache.org,38715,1676426496536}] 2023-02-15 02:01:39,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:39,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 93ca9ad69f0c8c16c09a22c04c91be9d, disabling compactions & flushes 2023-02-15 02:01:39,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. after waiting 0 ms 2023-02-15 02:01:39,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:39,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d. 2023-02-15 02:01:39,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 93ca9ad69f0c8c16c09a22c04c91be9d: 2023-02-15 02:01:39,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,677 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=93ca9ad69f0c8c16c09a22c04c91be9d, regionState=CLOSED 2023-02-15 02:01:39,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676426499677"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426499677"}]},"ts":"1676426499677"} 2023-02-15 02:01:39,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 02:01:39,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 93ca9ad69f0c8c16c09a22c04c91be9d, server=jenkins-hbase20.apache.org,38715,1676426496536 in 160 msec 2023-02-15 02:01:39,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 02:01:39,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=93ca9ad69f0c8c16c09a22c04c91be9d, UNASSIGN in 164 msec 2023-02-15 02:01:39,681 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426499681"}]},"ts":"1676426499681"} 2023-02-15 02:01:39,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-15 02:01:39,683 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-15 02:01:39,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 382 msec 2023-02-15 02:01:39,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:39,908 INFO [Listener at localhost.localdomain/45253] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-15 02:01:39,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:39,914 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,916 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1, FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2, FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/recovered.edits] 2023-02-15 02:01:39,918 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/904daa3827e84c9db3c204455f32fb61 to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/archive/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/904daa3827e84c9db3c204455f32fb61 2023-02-15 02:01:39,920 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/e44f55e06f724c93bf1ac072b1bed63e to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/archive/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f1/e44f55e06f724c93bf1ac072b1bed63e 2023-02-15 02:01:39,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/066f931395f84de8bdfd5799e34ca02f to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/archive/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/066f931395f84de8bdfd5799e34ca02f 2023-02-15 02:01:39,923 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/4219b67ecaec45e5ab311aa0757c9a29 to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/archive/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/f2/4219b67ecaec45e5ab311aa0757c9a29 2023-02-15 02:01:39,926 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/recovered.edits/12.seqid to hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/archive/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d/recovered.edits/12.seqid 2023-02-15 02:01:39,926 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/.tmp/data/default/testWithMockedMapReduceSingleRegion/93ca9ad69f0c8c16c09a22c04c91be9d 2023-02-15 02:01:39,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 02:01:39,928 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,929 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-15 02:01:39,931 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-15 02:01:39,932 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,932 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-15 02:01:39,932 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426499932"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:39,933 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 02:01:39,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 93ca9ad69f0c8c16c09a22c04c91be9d, NAME => 'testWithMockedMapReduceSingleRegion,,1676426497807.93ca9ad69f0c8c16c09a22c04c91be9d.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 02:01:39,933 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-15 02:01:39,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676426499933"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:39,935 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-15 02:01:39,936 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 02:01:39,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 28 msec 2023-02-15 02:01:40,012 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:40,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43451] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:40,015 INFO [Listener at localhost.localdomain/45253] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-15 02:01:40,015 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:40,015 INFO [Listener at localhost.localdomain/45253] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:40,016 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a608f34 to 127.0.0.1:57378 2023-02-15 02:01:40,016 DEBUG [Listener at localhost.localdomain/45253] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,016 DEBUG [Listener at localhost.localdomain/45253] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:40,016 DEBUG [Listener at localhost.localdomain/45253] util.JVMClusterUtil(257): Found active master hash=834647386, stopped=false 2023-02-15 02:01:40,016 INFO [Listener at localhost.localdomain/45253] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:40,017 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:40,018 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:40,019 INFO [Listener at localhost.localdomain/45253] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:40,017 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:40,019 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:40,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:40,019 DEBUG [Listener at localhost.localdomain/45253] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4933bd38 to 127.0.0.1:57378 2023-02-15 02:01:40,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:40,020 DEBUG [Listener at localhost.localdomain/45253] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:40,020 INFO [Listener at localhost.localdomain/45253] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,38715,1676426496536' ***** 2023-02-15 02:01:40,020 INFO [Listener at localhost.localdomain/45253] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:40,020 INFO [Listener at localhost.localdomain/45253] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,36417,1676426496565' ***** 2023-02-15 02:01:40,023 INFO [Listener at localhost.localdomain/45253] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:40,024 INFO [RS:0;jenkins-hbase20:38715] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:40,024 INFO [RS:1;jenkins-hbase20:36417] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:40,024 INFO [RS:0;jenkins-hbase20:38715] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:40,024 INFO [RS:0;jenkins-hbase20:38715] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:40,024 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(3304): Received CLOSE for 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:40,024 INFO [RS:1;jenkins-hbase20:36417] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:40,024 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:40,024 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:40,024 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:40,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 343231ae8db26e0c311ea72282b34432, disabling compactions & flushes 2023-02-15 02:01:40,024 INFO [RS:1;jenkins-hbase20:36417] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:40,024 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:40,026 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:40,026 DEBUG [RS:0;jenkins-hbase20:38715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01127e21 to 127.0.0.1:57378 2023-02-15 02:01:40,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:40,027 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,027 DEBUG [RS:1;jenkins-hbase20:36417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73a8f4e1 to 127.0.0.1:57378 2023-02-15 02:01:40,027 INFO [RS:0;jenkins-hbase20:38715] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:40,027 INFO [RS:0;jenkins-hbase20:38715] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:40,027 DEBUG [RS:1;jenkins-hbase20:36417] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,027 INFO [RS:0;jenkins-hbase20:38715] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. after waiting 0 ms 2023-02-15 02:01:40,027 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:40,027 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,36417,1676426496565; all regions closed. 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:40,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 343231ae8db26e0c311ea72282b34432 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:40,027 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 02:01:40,027 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 343231ae8db26e0c311ea72282b34432=hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432.} 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:40,027 DEBUG [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1505): Waiting on 1588230740, 343231ae8db26e0c311ea72282b34432 2023-02-15 02:01:40,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:40,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:40,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-15 02:01:40,031 DEBUG [RS:1;jenkins-hbase20:36417] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/oldWALs 2023-02-15 02:01:40,031 INFO [RS:1;jenkins-hbase20:36417] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36417%2C1676426496565:(num 1676426498042) 2023-02-15 02:01:40,031 DEBUG [RS:1;jenkins-hbase20:36417] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,031 INFO [RS:1;jenkins-hbase20:36417] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:40,031 INFO [RS:1;jenkins-hbase20:36417] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:40,031 INFO [RS:1;jenkins-hbase20:36417] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:40,031 INFO [RS:1;jenkins-hbase20:36417] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:40,031 INFO [RS:1;jenkins-hbase20:36417] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:40,031 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:40,032 INFO [RS:1;jenkins-hbase20:36417] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36417 2023-02-15 02:01:40,040 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:40,040 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36417,1676426496565 2023-02-15 02:01:40,040 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:40,040 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:40,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.58 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/.tmp/info/6f3483be569545399acd5a6a1e917151 2023-02-15 02:01:40,046 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1948b842 rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,047 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:40,047 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35b15ce8 rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/.tmp/info/6fb3080926d04a03803de0970be83ce1 2023-02-15 02:01:40,049 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36417,1676426496565] 2023-02-15 02:01:40,049 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36417,1676426496565; numProcessing=1 2023-02-15 02:01:40,050 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,36417,1676426496565 already deleted, retry=false 2023-02-15 02:01:40,050 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,36417,1676426496565 expired; onlineServers=1 2023-02-15 02:01:40,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f3483be569545399acd5a6a1e917151 2023-02-15 02:01:40,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/.tmp/info/6fb3080926d04a03803de0970be83ce1 as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/info/6fb3080926d04a03803de0970be83ce1 2023-02-15 02:01:40,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/info/6fb3080926d04a03803de0970be83ce1, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:40,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 343231ae8db26e0c311ea72282b34432 in 35ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:40,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/.tmp/rep_barrier/87aa1bfde13044ce8c9c7df597c0bbf0 2023-02-15 02:01:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/namespace/343231ae8db26e0c311ea72282b34432/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:40,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:40,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 343231ae8db26e0c311ea72282b34432: 2023-02-15 02:01:40,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426497246.343231ae8db26e0c311ea72282b34432. 2023-02-15 02:01:40,070 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87aa1bfde13044ce8c9c7df597c0bbf0 2023-02-15 02:01:40,081 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/.tmp/table/11aadd0a56224474a35deabe3eb00a0b 2023-02-15 02:01:40,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11aadd0a56224474a35deabe3eb00a0b 2023-02-15 02:01:40,085 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/.tmp/info/6f3483be569545399acd5a6a1e917151 as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/info/6f3483be569545399acd5a6a1e917151 2023-02-15 02:01:40,089 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:40,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f3483be569545399acd5a6a1e917151 2023-02-15 02:01:40,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/info/6f3483be569545399acd5a6a1e917151, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 02:01:40,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/.tmp/rep_barrier/87aa1bfde13044ce8c9c7df597c0bbf0 as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/rep_barrier/87aa1bfde13044ce8c9c7df597c0bbf0 2023-02-15 02:01:40,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87aa1bfde13044ce8c9c7df597c0bbf0 2023-02-15 02:01:40,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/rep_barrier/87aa1bfde13044ce8c9c7df597c0bbf0, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 02:01:40,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/.tmp/table/11aadd0a56224474a35deabe3eb00a0b as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/table/11aadd0a56224474a35deabe3eb00a0b 2023-02-15 02:01:40,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11aadd0a56224474a35deabe3eb00a0b 2023-02-15 02:01:40,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/table/11aadd0a56224474a35deabe3eb00a0b, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 02:01:40,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4316, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 135ms, sequenceid=21, compaction requested=false 2023-02-15 02:01:40,174 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 02:01:40,175 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:40,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:40,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:40,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:40,227 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,38715,1676426496536; all regions closed. 2023-02-15 02:01:40,234 DEBUG [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/oldWALs 2023-02-15 02:01:40,234 INFO [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38715%2C1676426496536.meta:.meta(num 1676426497183) 2023-02-15 02:01:40,238 DEBUG [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/oldWALs 2023-02-15 02:01:40,238 INFO [RS:0;jenkins-hbase20:38715] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38715%2C1676426496536:(num 1676426497587) 2023-02-15 02:01:40,238 DEBUG [RS:0;jenkins-hbase20:38715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,238 INFO [RS:0;jenkins-hbase20:38715] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:40,238 INFO [RS:0;jenkins-hbase20:38715] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:40,238 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:40,239 INFO [RS:0;jenkins-hbase20:38715] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38715 2023-02-15 02:01:40,240 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38715,1676426496536 2023-02-15 02:01:40,240 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:40,241 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38715,1676426496536] 2023-02-15 02:01:40,241 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38715,1676426496536; numProcessing=2 2023-02-15 02:01:40,241 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38715,1676426496536 already deleted, retry=false 2023-02-15 02:01:40,241 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38715,1676426496536 expired; onlineServers=0 2023-02-15 02:01:40,241 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,43451,1676426496472' ***** 2023-02-15 02:01:40,241 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:40,242 DEBUG [M:0;jenkins-hbase20:43451] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358027b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:40,243 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,43451,1676426496472 2023-02-15 02:01:40,243 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,43451,1676426496472; all regions closed. 2023-02-15 02:01:40,243 DEBUG [M:0;jenkins-hbase20:43451] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:40,243 DEBUG [M:0;jenkins-hbase20:43451] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:40,243 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:40,243 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426496745] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426496745,5,FailOnTimeoutGroup] 2023-02-15 02:01:40,243 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426496745] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426496745,5,FailOnTimeoutGroup] 2023-02-15 02:01:40,243 DEBUG [M:0;jenkins-hbase20:43451] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:40,244 INFO [M:0;jenkins-hbase20:43451] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:40,244 INFO [M:0;jenkins-hbase20:43451] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:40,244 INFO [M:0;jenkins-hbase20:43451] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:40,244 DEBUG [M:0;jenkins-hbase20:43451] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:40,244 INFO [M:0;jenkins-hbase20:43451] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:40,245 ERROR [M:0;jenkins-hbase20:43451] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 02:01:40,245 INFO [M:0;jenkins-hbase20:43451] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:40,245 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:40,245 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:40,245 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:40,245 DEBUG [M:0;jenkins-hbase20:43451] zookeeper.ZKUtil(398): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 02:01:40,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:40,245 WARN [M:0;jenkins-hbase20:43451] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 02:01:40,246 INFO [M:0;jenkins-hbase20:43451] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:40,246 INFO [M:0;jenkins-hbase20:43451] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:40,246 DEBUG [M:0;jenkins-hbase20:43451] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:40,246 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:40,246 DEBUG [M:0;jenkins-hbase20:43451] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:40,247 DEBUG [M:0;jenkins-hbase20:43451] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 1 ms 2023-02-15 02:01:40,247 DEBUG [M:0;jenkins-hbase20:43451] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:40,247 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.12 KB 2023-02-15 02:01:40,253 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:40,253 INFO [RS:1;jenkins-hbase20:36417] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,36417,1676426496565; zookeeper connection closed. 2023-02-15 02:01:40,253 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dc9d88c rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,253 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4fb5d20d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4fb5d20d 2023-02-15 02:01:40,253 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:36417-0x10163de0b6d0002, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:40,253 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73300c9 rejected from java.util.concurrent.ThreadPoolExecutor@1d772fb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,258 INFO [M:0;jenkins-hbase20:43451] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ccdccf95584f488a9e188a18b6c1ba07 2023-02-15 02:01:40,262 DEBUG [M:0;jenkins-hbase20:43451] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ccdccf95584f488a9e188a18b6c1ba07 as hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ccdccf95584f488a9e188a18b6c1ba07 2023-02-15 02:01:40,266 INFO [M:0;jenkins-hbase20:43451] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40143/user/jenkins/test-data/e73cea86-ac7a-4bcd-a7f4-2b83c7d02257/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ccdccf95584f488a9e188a18b6c1ba07, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 02:01:40,267 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57501, heapSize ~67.10 KB/68712, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-15 02:01:40,267 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:40,267 DEBUG [M:0;jenkins-hbase20:43451] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:40,269 INFO [M:0;jenkins-hbase20:43451] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:40,269 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:40,270 INFO [M:0;jenkins-hbase20:43451] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43451 2023-02-15 02:01:40,273 DEBUG [M:0;jenkins-hbase20:43451] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,43451,1676426496472 already deleted, retry=false 2023-02-15 02:01:40,656 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:40,656 INFO [M:0;jenkins-hbase20:43451] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,43451,1676426496472; zookeeper connection closed. 2023-02-15 02:01:40,656 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60fcce45 rejected from java.util.concurrent.ThreadPoolExecutor@64c35682[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,657 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): master:43451-0x10163de0b6d0000, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:40,657 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16a2a919 rejected from java.util.concurrent.ThreadPoolExecutor@64c35682[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,757 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:40,757 INFO [RS:0;jenkins-hbase20:38715] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,38715,1676426496536; zookeeper connection closed. 2023-02-15 02:01:40,757 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b992ff2 rejected from java.util.concurrent.ThreadPoolExecutor@7fa6a459[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,757 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1509187] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1509187 2023-02-15 02:01:40,757 DEBUG [Listener at localhost.localdomain/45253-EventThread] zookeeper.ZKWatcher(600): regionserver:38715-0x10163de0b6d0001, quorum=127.0.0.1:57378, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:40,757 ERROR [Listener at localhost.localdomain/45253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@39808233 rejected from java.util.concurrent.ThreadPoolExecutor@7fa6a459[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:40,757 INFO [Listener at localhost.localdomain/45253] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:40,758 WARN [Listener at localhost.localdomain/45253] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:40,763 INFO [Listener at localhost.localdomain/45253] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:40,870 WARN [BP-519727234-148.251.75.209-1676426495970 heartbeating to localhost.localdomain/127.0.0.1:40143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:40,870 WARN [BP-519727234-148.251.75.209-1676426495970 heartbeating to localhost.localdomain/127.0.0.1:40143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-519727234-148.251.75.209-1676426495970 (Datanode Uuid 6ba9ee8e-76c4-4b43-b3d1-d622778e0d93) service to localhost.localdomain/127.0.0.1:40143 2023-02-15 02:01:40,871 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/dfs/data/data3/current/BP-519727234-148.251.75.209-1676426495970] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:40,871 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/dfs/data/data4/current/BP-519727234-148.251.75.209-1676426495970] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:40,873 WARN [Listener at localhost.localdomain/45253] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:40,875 INFO [Listener at localhost.localdomain/45253] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:40,978 WARN [BP-519727234-148.251.75.209-1676426495970 heartbeating to localhost.localdomain/127.0.0.1:40143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:40,979 WARN [BP-519727234-148.251.75.209-1676426495970 heartbeating to localhost.localdomain/127.0.0.1:40143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-519727234-148.251.75.209-1676426495970 (Datanode Uuid c0365e00-6768-4eef-8736-27287f810a85) service to localhost.localdomain/127.0.0.1:40143 2023-02-15 02:01:40,980 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/dfs/data/data1/current/BP-519727234-148.251.75.209-1676426495970] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:40,980 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/cluster_fc3cb666-a76f-7a5d-3ea2-64f8ad3b3af0/dfs/data/data2/current/BP-519727234-148.251.75.209-1676426495970] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:40,989 INFO [Listener at localhost.localdomain/45253] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:41,099 INFO [Listener at localhost.localdomain/45253] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:41,117 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:41,127 INFO [Listener at localhost.localdomain/45253] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 231) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost.localdomain:40143 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:40143 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase20.apache.org,43451,1676426496472)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:40143 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40143 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/45253.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/45253 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:40143 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost.localdomain:40143 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:40143 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=650 (was 632) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 270), ProcessCount=162 (was 163), AvailableMemoryMB=5565 (was 5624) 2023-02-15 02:01:41,137 INFO [Listener at localhost.localdomain/45253] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=162, AvailableMemoryMB=5565 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/hadoop.log.dir so I do NOT create it in target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c 2023-02-15 02:01:41,145 WARN [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/hadoop.tmp.dir so I do NOT create it in target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c 2023-02-15 02:01:41,145 WARN [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9368412a-fd9d-2625-a43b-04e93c9e4812/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 02:01:41,145 DEBUG [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372, deleteOnExit=true 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/test.cache.data in system properties and HBase conf 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:01:41,145 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:01:41,146 DEBUG [Listener at localhost.localdomain/45253] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:01:41,146 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:01:41,147 INFO [Listener at localhost.localdomain/45253] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:01:41,149 WARN [Listener at localhost.localdomain/45253] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:41,150 WARN [Listener at localhost.localdomain/45253] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:41,172 WARN [Listener at localhost.localdomain/45253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:41,173 INFO [Listener at localhost.localdomain/45253] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:41,179 INFO [Listener at localhost.localdomain/45253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/java.io.tmpdir/Jetty_localhost_localdomain_40145_hdfs____.3ykgj4/webapp 2023-02-15 02:01:41,257 INFO [Listener at localhost.localdomain/45253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:40145 2023-02-15 02:01:41,260 WARN [Listener at localhost.localdomain/45253] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:41,260 WARN [Listener at localhost.localdomain/45253] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:41,294 WARN [Listener at localhost.localdomain/37299] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:41,314 WARN [Listener at localhost.localdomain/37299] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:41,319 WARN [Listener at localhost.localdomain/37299] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:41,320 INFO [Listener at localhost.localdomain/37299] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:41,325 INFO [Listener at localhost.localdomain/37299] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/java.io.tmpdir/Jetty_localhost_46347_datanode____.u4tz39/webapp 2023-02-15 02:01:41,397 INFO [Listener at localhost.localdomain/37299] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46347 2023-02-15 02:01:41,407 WARN [Listener at localhost.localdomain/36557] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:41,424 WARN [Listener at localhost.localdomain/36557] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:41,427 WARN [Listener at localhost.localdomain/36557] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:41,427 INFO [Listener at localhost.localdomain/36557] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:41,430 INFO [Listener at localhost.localdomain/36557] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/java.io.tmpdir/Jetty_localhost_39935_datanode____is5uvw/webapp 2023-02-15 02:01:41,487 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d199b585733918f: Processing first storage report for DS-bc77797c-5a96-4751-8908-be5a0afd0fa7 from datanode e651bb80-3711-4153-b189-8df0e282c3f0 2023-02-15 02:01:41,487 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d199b585733918f: from storage DS-bc77797c-5a96-4751-8908-be5a0afd0fa7 node DatanodeRegistration(127.0.0.1:34153, datanodeUuid=e651bb80-3711-4153-b189-8df0e282c3f0, infoPort=40715, infoSecurePort=0, ipcPort=36557, storageInfo=lv=-57;cid=testClusterID;nsid=467392987;c=1676426501151), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:41,487 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d199b585733918f: Processing first storage report for DS-da860329-ceff-4072-8411-73185c00ef82 from datanode e651bb80-3711-4153-b189-8df0e282c3f0 2023-02-15 02:01:41,487 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d199b585733918f: from storage DS-da860329-ceff-4072-8411-73185c00ef82 node DatanodeRegistration(127.0.0.1:34153, datanodeUuid=e651bb80-3711-4153-b189-8df0e282c3f0, infoPort=40715, infoSecurePort=0, ipcPort=36557, storageInfo=lv=-57;cid=testClusterID;nsid=467392987;c=1676426501151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:41,511 INFO [Listener at localhost.localdomain/36557] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39935 2023-02-15 02:01:41,521 WARN [Listener at localhost.localdomain/40263] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:41,581 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde892f882f544eb1: Processing first storage report for DS-18607f93-5f52-44b4-b53a-fd871ef9ad79 from datanode 3a771c4a-2ca6-4df0-911f-563e4bec251a 2023-02-15 02:01:41,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde892f882f544eb1: from storage DS-18607f93-5f52-44b4-b53a-fd871ef9ad79 node DatanodeRegistration(127.0.0.1:40535, datanodeUuid=3a771c4a-2ca6-4df0-911f-563e4bec251a, infoPort=41549, infoSecurePort=0, ipcPort=40263, storageInfo=lv=-57;cid=testClusterID;nsid=467392987;c=1676426501151), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:41,581 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde892f882f544eb1: Processing first storage report for DS-f9dd7f2f-9147-4d83-bde6-d23d91d08334 from datanode 3a771c4a-2ca6-4df0-911f-563e4bec251a 2023-02-15 02:01:41,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde892f882f544eb1: from storage DS-f9dd7f2f-9147-4d83-bde6-d23d91d08334 node DatanodeRegistration(127.0.0.1:40535, datanodeUuid=3a771c4a-2ca6-4df0-911f-563e4bec251a, infoPort=41549, infoSecurePort=0, ipcPort=40263, storageInfo=lv=-57;cid=testClusterID;nsid=467392987;c=1676426501151), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:41,628 DEBUG [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c 2023-02-15 02:01:41,630 INFO [Listener at localhost.localdomain/40263] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/zookeeper_0, clientPort=63048, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:01:41,632 INFO [Listener at localhost.localdomain/40263] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63048 2023-02-15 02:01:41,632 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,633 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,651 INFO [Listener at localhost.localdomain/40263] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5 with version=8 2023-02-15 02:01:41,651 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,652 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,652 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37299/user/jenkins/test-data/9d494445-17a2-d6db-5bff-73f831d4ba8b/hbase-staging 2023-02-15 02:01:41,654 INFO [Listener at localhost.localdomain/40263] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:41,654 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,654 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,654 INFO [Listener at localhost.localdomain/40263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:41,654 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,654 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:41,655 INFO [Listener at localhost.localdomain/40263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:41,655 INFO [Listener at localhost.localdomain/40263] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40989 2023-02-15 02:01:41,656 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,656 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,657 INFO [Listener at localhost.localdomain/40263] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40989 connecting to ZooKeeper ensemble=127.0.0.1:63048 2023-02-15 02:01:41,664 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:409890x0, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:41,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40989-0x10163de1fad0000 connected 2023-02-15 02:01:41,682 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:41,682 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:41,683 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:41,686 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40989 2023-02-15 02:01:41,687 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40989 2023-02-15 02:01:41,687 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40989 2023-02-15 02:01:41,690 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40989 2023-02-15 02:01:41,691 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40989 2023-02-15 02:01:41,691 INFO [Listener at localhost.localdomain/40263] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5, hbase.cluster.distributed=false 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:41,702 INFO [Listener at localhost.localdomain/40263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:41,703 INFO [Listener at localhost.localdomain/40263] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35767 2023-02-15 02:01:41,703 INFO [Listener at localhost.localdomain/40263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:41,704 DEBUG [Listener at localhost.localdomain/40263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:41,704 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,705 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,705 INFO [Listener at localhost.localdomain/40263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35767 connecting to ZooKeeper ensemble=127.0.0.1:63048 2023-02-15 02:01:41,709 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:357670x0, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:41,709 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): regionserver:357670x0, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:41,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35767-0x10163de1fad0001 connected 2023-02-15 02:01:41,710 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:41,711 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:41,712 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35767 2023-02-15 02:01:41,713 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35767 2023-02-15 02:01:41,715 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35767 2023-02-15 02:01:41,717 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35767 2023-02-15 02:01:41,717 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35767 2023-02-15 02:01:41,730 INFO [Listener at localhost.localdomain/40263] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:41,731 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,731 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,731 INFO [Listener at localhost.localdomain/40263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:41,731 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:41,731 INFO [Listener at localhost.localdomain/40263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:41,731 INFO [Listener at localhost.localdomain/40263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:41,732 INFO [Listener at localhost.localdomain/40263] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34431 2023-02-15 02:01:41,732 INFO [Listener at localhost.localdomain/40263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:41,733 DEBUG [Listener at localhost.localdomain/40263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:41,733 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,734 INFO [Listener at localhost.localdomain/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,735 INFO [Listener at localhost.localdomain/40263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34431 connecting to ZooKeeper ensemble=127.0.0.1:63048 2023-02-15 02:01:41,737 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:344310x0, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:41,737 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): regionserver:344310x0, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:41,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34431-0x10163de1fad0002 connected 2023-02-15 02:01:41,739 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:41,739 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:41,747 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34431 2023-02-15 02:01:41,751 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34431 2023-02-15 02:01:41,754 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34431 2023-02-15 02:01:41,754 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34431 2023-02-15 02:01:41,755 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34431 2023-02-15 02:01:41,757 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,766 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:41,767 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,770 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:41,771 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:41,770 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:41,772 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:41,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:41,776 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,40989,1676426501653 from backup master directory 2023-02-15 02:01:41,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:41,783 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,783 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:41,783 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:41,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/hbase.id with ID: 038bddd8-70c0-4059-9181-7f2dc556679b 2023-02-15 02:01:41,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:41,824 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:41,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x543d0a50 to 127.0.0.1:63048 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:41,850 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@662647d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:41,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:41,851 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:01:41,851 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:41,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store-tmp 2023-02-15 02:01:41,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:41,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:41,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:41,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:41,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:41,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:41,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:41,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:41,858 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/WALs/jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40989%2C1676426501653, suffix=, logDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/WALs/jenkins-hbase20.apache.org,40989,1676426501653, archiveDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/oldWALs, maxLogs=10 2023-02-15 02:01:41,870 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK] 2023-02-15 02:01:41,871 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK] 2023-02-15 02:01:41,873 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/WALs/jenkins-hbase20.apache.org,40989,1676426501653/jenkins-hbase20.apache.org%2C40989%2C1676426501653.1676426501860 2023-02-15 02:01:41,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK], DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK]] 2023-02-15 02:01:41,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:41,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:41,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:41,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:41,875 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:41,877 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:41,877 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:41,883 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:41,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:41,884 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:41,886 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:41,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:41,888 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61585696, jitterRate=-0.08230161666870117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:41,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:41,888 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:41,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:41,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:41,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:41,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 02:01:41,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 02:01:41,890 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:41,894 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:41,895 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:41,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:41,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:41,903 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:41,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:41,904 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:41,905 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:41,906 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:41,906 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:41,907 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:41,907 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:41,907 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:41,908 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:41,907 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:41,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,40989,1676426501653, sessionid=0x10163de1fad0000, setting cluster-up flag (Was=false) 2023-02-15 02:01:41,911 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:41,913 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:41,913 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,915 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:41,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:41,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:41,919 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.hbase-snapshot/.tmp 2023-02-15 02:01:41,920 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:41,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426531927 2023-02-15 02:01:41,927 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:41,927 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:41,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:41,928 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:41,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:41,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:41,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:41,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:41,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:41,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:41,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426501937,5,FailOnTimeoutGroup] 2023-02-15 02:01:41,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426501938,5,FailOnTimeoutGroup] 2023-02-15 02:01:41,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:41,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:41,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:41,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:41,951 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:41,952 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:41,952 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5 2023-02-15 02:01:41,959 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(952): ClusterId : 038bddd8-70c0-4059-9181-7f2dc556679b 2023-02-15 02:01:41,959 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:41,961 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:41,961 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:41,962 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:41,963 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:41,964 DEBUG [RS:0;jenkins-hbase20:35767] zookeeper.ReadOnlyZKClient(139): Connect 0x1592265d to 127.0.0.1:63048 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:41,964 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(952): ClusterId : 038bddd8-70c0-4059-9181-7f2dc556679b 2023-02-15 02:01:41,965 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:41,966 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:41,966 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:41,968 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:41,970 DEBUG [RS:1;jenkins-hbase20:34431] zookeeper.ReadOnlyZKClient(139): Connect 0x33989c57 to 127.0.0.1:63048 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:41,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:41,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/info 2023-02-15 02:01:41,975 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:41,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:41,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:41,976 DEBUG [RS:1;jenkins-hbase20:34431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d5f6454, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:41,977 DEBUG [RS:1;jenkins-hbase20:34431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3960f727, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:41,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:41,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:41,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:41,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:41,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/table 2023-02-15 02:01:41,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:41,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:41,980 DEBUG [RS:0;jenkins-hbase20:35767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b55ca9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:41,981 DEBUG [RS:0;jenkins-hbase20:35767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f6a4d2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:41,981 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740 2023-02-15 02:01:41,981 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740 2023-02-15 02:01:41,983 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:41,984 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:41,986 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34431 2023-02-15 02:01:41,986 INFO [RS:1;jenkins-hbase20:34431] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:41,986 INFO [RS:1;jenkins-hbase20:34431] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:41,986 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:41,990 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:35767 2023-02-15 02:01:41,990 INFO [RS:0;jenkins-hbase20:35767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:41,990 INFO [RS:0;jenkins-hbase20:35767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:41,990 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:41,991 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40989,1676426501653 with isa=jenkins-hbase20.apache.org/148.251.75.209:34431, startcode=1676426501730 2023-02-15 02:01:41,991 DEBUG [RS:1;jenkins-hbase20:34431] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:41,993 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40989,1676426501653 with isa=jenkins-hbase20.apache.org/148.251.75.209:35767, startcode=1676426501702 2023-02-15 02:01:41,993 DEBUG [RS:0;jenkins-hbase20:35767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:42,027 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:42,027 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48301, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:42,028 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74956798, jitterRate=0.11694332957267761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:42,028 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:42,028 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:42,028 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:42,028 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:42,028 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:42,028 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:42,032 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54793, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:42,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40989] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,034 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:42,034 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:42,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,036 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5 2023-02-15 02:01:42,036 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37299 2023-02-15 02:01:42,036 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:42,036 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5 2023-02-15 02:01:42,036 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:42,036 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:42,036 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37299 2023-02-15 02:01:42,036 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:42,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:42,039 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:42,039 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:42,041 DEBUG [RS:1;jenkins-hbase20:34431] zookeeper.ZKUtil(162): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,041 WARN [RS:1;jenkins-hbase20:34431] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:42,041 INFO [RS:1;jenkins-hbase20:34431] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:42,041 DEBUG [RS:0;jenkins-hbase20:35767] zookeeper.ZKUtil(162): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,041 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,041 WARN [RS:0;jenkins-hbase20:35767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:42,041 INFO [RS:0;jenkins-hbase20:35767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:42,041 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,051 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:42,051 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34431,1676426501730] 2023-02-15 02:01:42,052 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35767,1676426501702] 2023-02-15 02:01:42,061 DEBUG [RS:1;jenkins-hbase20:34431] zookeeper.ZKUtil(162): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,061 DEBUG [RS:0;jenkins-hbase20:35767] zookeeper.ZKUtil(162): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,062 DEBUG [RS:1;jenkins-hbase20:34431] zookeeper.ZKUtil(162): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,062 DEBUG [RS:0;jenkins-hbase20:35767] zookeeper.ZKUtil(162): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,062 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:42,062 DEBUG [RS:1;jenkins-hbase20:34431] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:42,063 INFO [RS:1;jenkins-hbase20:34431] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:42,063 INFO [RS:0;jenkins-hbase20:35767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:42,064 INFO [RS:1;jenkins-hbase20:34431] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:42,064 INFO [RS:1;jenkins-hbase20:34431] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:42,064 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,064 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:42,066 INFO [RS:0;jenkins-hbase20:35767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:42,066 INFO [RS:0;jenkins-hbase20:35767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:42,066 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,066 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,066 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,066 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,066 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,066 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,066 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,066 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:42,067 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:42,067 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,070 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,070 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,070 DEBUG [RS:1;jenkins-hbase20:34431] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,070 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,072 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,074 DEBUG [RS:0;jenkins-hbase20:35767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:42,085 INFO [RS:1;jenkins-hbase20:34431] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:42,087 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34431,1676426501730-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,087 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,087 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,087 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,099 INFO [RS:0;jenkins-hbase20:35767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:42,099 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35767,1676426501702-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,100 INFO [RS:1;jenkins-hbase20:34431] regionserver.Replication(203): jenkins-hbase20.apache.org,34431,1676426501730 started 2023-02-15 02:01:42,100 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34431,1676426501730, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34431, sessionid=0x10163de1fad0002 2023-02-15 02:01:42,100 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:42,100 DEBUG [RS:1;jenkins-hbase20:34431] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,100 DEBUG [RS:1;jenkins-hbase20:34431] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34431,1676426501730' 2023-02-15 02:01:42,100 DEBUG [RS:1;jenkins-hbase20:34431] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:42,100 DEBUG [RS:1;jenkins-hbase20:34431] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:42,100 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:42,101 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:42,101 DEBUG [RS:1;jenkins-hbase20:34431] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:42,101 DEBUG [RS:1;jenkins-hbase20:34431] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34431,1676426501730' 2023-02-15 02:01:42,101 DEBUG [RS:1;jenkins-hbase20:34431] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:42,101 DEBUG [RS:1;jenkins-hbase20:34431] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:42,101 DEBUG [RS:1;jenkins-hbase20:34431] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:42,101 INFO [RS:1;jenkins-hbase20:34431] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:42,101 INFO [RS:1;jenkins-hbase20:34431] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:42,119 INFO [RS:0;jenkins-hbase20:35767] regionserver.Replication(203): jenkins-hbase20.apache.org,35767,1676426501702 started 2023-02-15 02:01:42,119 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,35767,1676426501702, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35767, sessionid=0x10163de1fad0001 2023-02-15 02:01:42,119 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:42,119 DEBUG [RS:0;jenkins-hbase20:35767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,119 DEBUG [RS:0;jenkins-hbase20:35767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35767,1676426501702' 2023-02-15 02:01:42,119 DEBUG [RS:0;jenkins-hbase20:35767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:42,119 DEBUG [RS:0;jenkins-hbase20:35767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:42,120 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:42,120 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:42,120 DEBUG [RS:0;jenkins-hbase20:35767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,120 DEBUG [RS:0;jenkins-hbase20:35767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35767,1676426501702' 2023-02-15 02:01:42,120 DEBUG [RS:0;jenkins-hbase20:35767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:42,120 DEBUG [RS:0;jenkins-hbase20:35767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:42,121 DEBUG [RS:0;jenkins-hbase20:35767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:42,121 INFO [RS:0;jenkins-hbase20:35767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:42,121 INFO [RS:0;jenkins-hbase20:35767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:42,207 DEBUG [jenkins-hbase20:40989] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:42,207 DEBUG [jenkins-hbase20:40989] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:42,208 DEBUG [jenkins-hbase20:40989] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:42,208 DEBUG [jenkins-hbase20:40989] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:42,208 DEBUG [jenkins-hbase20:40989] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:42,210 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35767,1676426501702, state=OPENING 2023-02-15 02:01:42,211 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:42,212 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:42,213 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:42,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35767,1676426501702}] 2023-02-15 02:01:42,368 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,368 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:42,370 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:42,374 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:42,374 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:42,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35767%2C1676426501702.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,35767,1676426501702, archiveDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/oldWALs, maxLogs=32 2023-02-15 02:01:42,393 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK] 2023-02-15 02:01:42,393 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK] 2023-02-15 02:01:42,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,35767,1676426501702/jenkins-hbase20.apache.org%2C35767%2C1676426501702.meta.1676426502378.meta 2023-02-15 02:01:42,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK], DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK]] 2023-02-15 02:01:42,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:42,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:42,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:42,401 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:42,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:42,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:42,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:42,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:42,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:42,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/info 2023-02-15 02:01:42,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/info 2023-02-15 02:01:42,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:42,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:42,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:42,405 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:42,405 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:42,405 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:42,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:42,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:42,406 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/table 2023-02-15 02:01:42,406 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/table 2023-02-15 02:01:42,406 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:42,407 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:42,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740 2023-02-15 02:01:42,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740 2023-02-15 02:01:42,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:42,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:42,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64690320, jitterRate=-0.036039113998413086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:42,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:42,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426502368 2023-02-15 02:01:42,418 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:42,419 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:42,419 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35767,1676426501702, state=OPEN 2023-02-15 02:01:42,420 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:42,420 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:42,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:42,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35767,1676426501702 in 207 msec 2023-02-15 02:01:42,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:42,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 385 msec 2023-02-15 02:01:42,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 502 msec 2023-02-15 02:01:42,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426502423, completionTime=-1 2023-02-15 02:01:42,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:42,423 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:42,427 DEBUG [hconnection-0x520fd2a1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:42,429 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:42,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:42,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426562431 2023-02-15 02:01:42,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426622431 2023-02-15 02:01:42,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40989,1676426501653-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40989,1676426501653-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40989,1676426501653-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:40989, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:42,445 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:42,446 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:42,448 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:42,448 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:42,449 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:42,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f empty. 2023-02-15 02:01:42,457 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,457 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:42,474 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:42,475 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b145418d3bc0988cd7f48cdebdcb7d5f, NAME => 'hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp 2023-02-15 02:01:42,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:42,483 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b145418d3bc0988cd7f48cdebdcb7d5f, disabling compactions & flushes 2023-02-15 02:01:42,483 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,483 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,483 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. after waiting 0 ms 2023-02-15 02:01:42,483 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,483 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,483 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b145418d3bc0988cd7f48cdebdcb7d5f: 2023-02-15 02:01:42,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:42,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426502485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426502485"}]},"ts":"1676426502485"} 2023-02-15 02:01:42,486 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:42,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:42,487 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426502487"}]},"ts":"1676426502487"} 2023-02-15 02:01:42,488 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:42,490 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:42,491 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:42,491 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:42,491 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:42,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b145418d3bc0988cd7f48cdebdcb7d5f, ASSIGN}] 2023-02-15 02:01:42,494 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b145418d3bc0988cd7f48cdebdcb7d5f, ASSIGN 2023-02-15 02:01:42,499 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b145418d3bc0988cd7f48cdebdcb7d5f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35767,1676426501702; forceNewPlan=false, retain=false 2023-02-15 02:01:42,649 INFO [jenkins-hbase20:40989] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:42,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b145418d3bc0988cd7f48cdebdcb7d5f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426502649"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426502649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426502649"}]},"ts":"1676426502649"} 2023-02-15 02:01:42,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b145418d3bc0988cd7f48cdebdcb7d5f, server=jenkins-hbase20.apache.org,35767,1676426501702}] 2023-02-15 02:01:42,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,808 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35767%2C1676426501702, suffix=, logDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,35767,1676426501702, archiveDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/oldWALs, maxLogs=32 2023-02-15 02:01:42,819 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK] 2023-02-15 02:01:42,819 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK] 2023-02-15 02:01:42,823 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,35767,1676426501702/jenkins-hbase20.apache.org%2C35767%2C1676426501702.1676426502809 2023-02-15 02:01:42,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK], DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK]] 2023-02-15 02:01:42,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b145418d3bc0988cd7f48cdebdcb7d5f, NAME => 'hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:42,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:42,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,827 INFO [StoreOpener-b145418d3bc0988cd7f48cdebdcb7d5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,828 DEBUG [StoreOpener-b145418d3bc0988cd7f48cdebdcb7d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/info 2023-02-15 02:01:42,828 DEBUG [StoreOpener-b145418d3bc0988cd7f48cdebdcb7d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/info 2023-02-15 02:01:42,828 INFO [StoreOpener-b145418d3bc0988cd7f48cdebdcb7d5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b145418d3bc0988cd7f48cdebdcb7d5f columnFamilyName info 2023-02-15 02:01:42,829 INFO [StoreOpener-b145418d3bc0988cd7f48cdebdcb7d5f-1] regionserver.HStore(310): Store=b145418d3bc0988cd7f48cdebdcb7d5f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:42,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,830 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:42,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:42,835 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b145418d3bc0988cd7f48cdebdcb7d5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62278980, jitterRate=-0.0719708800315857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:42,836 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b145418d3bc0988cd7f48cdebdcb7d5f: 2023-02-15 02:01:42,836 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f., pid=6, masterSystemTime=1676426502803 2023-02-15 02:01:42,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:42,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b145418d3bc0988cd7f48cdebdcb7d5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:42,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426502840"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426502840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426502840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426502840"}]},"ts":"1676426502840"} 2023-02-15 02:01:42,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:42,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b145418d3bc0988cd7f48cdebdcb7d5f, server=jenkins-hbase20.apache.org,35767,1676426501702 in 190 msec 2023-02-15 02:01:42,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:42,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b145418d3bc0988cd7f48cdebdcb7d5f, ASSIGN in 352 msec 2023-02-15 02:01:42,844 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:42,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426502844"}]},"ts":"1676426502844"} 2023-02-15 02:01:42,845 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:42,847 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:42,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:42,848 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:42,848 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:42,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 402 msec 2023-02-15 02:01:42,851 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:42,862 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:42,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 17 msec 2023-02-15 02:01:42,873 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:42,879 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:42,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-15 02:01:42,892 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:42,893 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:42,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.110sec 2023-02-15 02:01:42,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:42,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:42,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:42,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40989,1676426501653-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:42,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40989,1676426501653-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:42,895 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:42,965 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ReadOnlyZKClient(139): Connect 0x11902d8d to 127.0.0.1:63048 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:42,968 DEBUG [Listener at localhost.localdomain/40263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17c3f1b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:42,972 DEBUG [hconnection-0x70b8c1ef-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:42,974 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:42,975 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:42,975 DEBUG [Listener at localhost.localdomain/40263] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:42,978 DEBUG [Listener at localhost.localdomain/40263] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:42,983 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:42,983 INFO [Listener at localhost.localdomain/40263] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:42,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:42,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:42,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 148.251.75.209:39164 deadline: 1676426562983, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:42,984 INFO [Listener at localhost.localdomain/40263] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 02:01:42,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:42,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:42,989 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:42,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-15 02:01:42,989 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:42,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:42,990 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:42,991 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f empty. 2023-02-15 02:01:42,991 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:42,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 02:01:42,999 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:43,000 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => ea8315a228292088e8fc65ce1de78e9f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp 2023-02-15 02:01:43,005 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:43,006 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing ea8315a228292088e8fc65ce1de78e9f, disabling compactions & flushes 2023-02-15 02:01:43,006 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,006 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,006 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. after waiting 0 ms 2023-02-15 02:01:43,006 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,006 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,006 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for ea8315a228292088e8fc65ce1de78e9f: 2023-02-15 02:01:43,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:43,008 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676426503008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426503008"}]},"ts":"1676426503008"} 2023-02-15 02:01:43,010 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:43,010 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:43,010 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426503010"}]},"ts":"1676426503010"} 2023-02-15 02:01:43,011 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-15 02:01:43,014 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:43,015 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:43,015 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:43,015 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:43,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, ASSIGN}] 2023-02-15 02:01:43,017 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, ASSIGN 2023-02-15 02:01:43,018 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35767,1676426501702; forceNewPlan=false, retain=false 2023-02-15 02:01:43,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:43,103 INFO [RS:1;jenkins-hbase20:34431] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34431%2C1676426501730, suffix=, logDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,34431,1676426501730, archiveDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/oldWALs, maxLogs=32 2023-02-15 02:01:43,133 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK] 2023-02-15 02:01:43,133 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK] 2023-02-15 02:01:43,138 INFO [RS:1;jenkins-hbase20:34431] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,34431,1676426501730/jenkins-hbase20.apache.org%2C34431%2C1676426501730.1676426503103 2023-02-15 02:01:43,140 DEBUG [RS:1;jenkins-hbase20:34431] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40535,DS-18607f93-5f52-44b4-b53a-fd871ef9ad79,DISK], DatanodeInfoWithStorage[127.0.0.1:34153,DS-bc77797c-5a96-4751-8908-be5a0afd0fa7,DISK]] 2023-02-15 02:01:43,168 INFO [jenkins-hbase20:40989] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:43,168 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ea8315a228292088e8fc65ce1de78e9f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,169 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676426503168"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426503168"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426503168"}]},"ts":"1676426503168"} 2023-02-15 02:01:43,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ea8315a228292088e8fc65ce1de78e9f, server=jenkins-hbase20.apache.org,35767,1676426501702}] 2023-02-15 02:01:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:43,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ea8315a228292088e8fc65ce1de78e9f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:43,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:43,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,327 INFO [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,329 DEBUG [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1 2023-02-15 02:01:43,329 DEBUG [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1 2023-02-15 02:01:43,330 INFO [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea8315a228292088e8fc65ce1de78e9f columnFamilyName f1 2023-02-15 02:01:43,330 INFO [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] regionserver.HStore(310): Store=ea8315a228292088e8fc65ce1de78e9f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:43,331 INFO [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,332 DEBUG [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2 2023-02-15 02:01:43,332 DEBUG [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2 2023-02-15 02:01:43,332 INFO [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea8315a228292088e8fc65ce1de78e9f columnFamilyName f2 2023-02-15 02:01:43,333 INFO [StoreOpener-ea8315a228292088e8fc65ce1de78e9f-1] regionserver.HStore(310): Store=ea8315a228292088e8fc65ce1de78e9f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:43,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:43,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:43,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:43,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ea8315a228292088e8fc65ce1de78e9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72166497, jitterRate=0.0753646045923233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:43,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ea8315a228292088e8fc65ce1de78e9f: 2023-02-15 02:01:43,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f., pid=12, masterSystemTime=1676426503322 2023-02-15 02:01:43,360 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ea8315a228292088e8fc65ce1de78e9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,360 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676426503360"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426503360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426503360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426503360"}]},"ts":"1676426503360"} 2023-02-15 02:01:43,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 02:01:43,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ea8315a228292088e8fc65ce1de78e9f, server=jenkins-hbase20.apache.org,35767,1676426501702 in 193 msec 2023-02-15 02:01:43,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 02:01:43,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, ASSIGN in 349 msec 2023-02-15 02:01:43,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:43,367 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426503367"}]},"ts":"1676426503367"} 2023-02-15 02:01:43,369 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-15 02:01:43,371 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:43,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 385 msec 2023-02-15 02:01:43,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:43,595 INFO [Listener at localhost.localdomain/40263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-15 02:01:43,595 DEBUG [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-15 02:01:43,595 INFO [Listener at localhost.localdomain/40263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:43,597 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-15 02:01:43,598 INFO [Listener at localhost.localdomain/40263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:43,598 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-15 02:01:43,598 INFO [Listener at localhost.localdomain/40263] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:43,632 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35767] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,706 INFO [Listener at localhost.localdomain/40263] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:43,706 INFO [Listener at localhost.localdomain/40263] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:43,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 02:01:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426503707 (current time:1676426503707). 2023-02-15 02:01:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:43,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] zookeeper.ReadOnlyZKClient(139): Connect 0x34a65ff8 to 127.0.0.1:63048 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e06c1f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:43,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:43,712 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:43,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34a65ff8 to 127.0.0.1:63048 2023-02-15 02:01:43,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:43,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:43,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 02:01:43,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 02:01:43,716 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 02:01:43,717 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676427103717 2023-02-15 02:01:43,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 02:01:43,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:43,718 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:43,719 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:43,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 02:01:43,720 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 02:01:43,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-15 02:01:43,722 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 02:01:43,722 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676427103722 2023-02-15 02:01:43,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 02:01:43,731 INFO [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 02:01:43,731 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:43,732 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 02:01:43,732 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 02:01:43,732 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,732 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,733 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,733 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:43,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:43,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:43,733 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,733 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:43,735 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:43,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,735 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 02:01:43,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 02:01:43,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 02:01:43,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 02:01:43,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 02:01:43,738 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 02:01:43,738 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:43,739 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 02:01:43,739 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 02:01:43,739 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:43,739 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 02:01:43,740 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 02:01:43,740 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 02:01:43,740 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34431,1676426501730' joining acquired barrier for procedure (foo) in zk 2023-02-15 02:01:43,740 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35767,1676426501702' joining acquired barrier for procedure (foo) in zk 2023-02-15 02:01:43,745 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,746 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,746 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:43,746 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,746 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:43,746 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:43,746 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:43,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:43,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35767,1676426501702' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 02:01:43,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bfe6906[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:43,747 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 02:01:43,747 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,749 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,749 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,749 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 02:01:43,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,750 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,750 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:43,750 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 02:01:43,750 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 02:01:43,750 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,34431,1676426501730' in zk 2023-02-15 02:01:43,750 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 02:01:43,750 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:43,750 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 02:01:43,751 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 02:01:43,751 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:43,751 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,751 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. started... 2023-02-15 02:01:43,751 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ea8315a228292088e8fc65ce1de78e9f 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 02:01:43,765 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f1/80af2faa911f4e37ba65994041b9da88 2023-02-15 02:01:43,787 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f2/d39b3d3011ff4f66ba110b5d73d07e3e 2023-02-15 02:01:43,791 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f1/80af2faa911f4e37ba65994041b9da88 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88 2023-02-15 02:01:43,796 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:43,797 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f2/d39b3d3011ff4f66ba110b5d73d07e3e as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e 2023-02-15 02:01:43,801 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:43,802 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ea8315a228292088e8fc65ce1de78e9f in 51ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ea8315a228292088e8fc65ce1de78e9f: 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.' region-info for snapshot=foo 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88] hfiles 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88 for snapshot=foo 2023-02-15 02:01:43,802 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e] hfiles 2023-02-15 02:01:43,803 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e for snapshot=foo 2023-02-15 02:01:43,813 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. completed. 2023-02-15 02:01:43,813 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:43,813 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 02:01:43,813 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 02:01:43,813 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,813 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 02:01:43,813 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,35767,1676426501702' in zk 2023-02-15 02:01:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 02:01:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:43,815 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 02:01:43,815 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:43,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,35767,1676426501702': 2023-02-15 02:01:43,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35767,1676426501702' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 02:01:43,818 INFO [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 02:01:43,818 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:43,818 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:43,818 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 02:01:43,819 INFO [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:43,819 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:43,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 02:01:43,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:43,820 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:43,820 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:43,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:43,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,827 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:43,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:43,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:43,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:43,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,829 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,829 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:43,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 02:01:43,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,835 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:43,835 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:43,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:43,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,836 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,837 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:43,837 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 02:01:43,837 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 02:01:43,837 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:43,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:43,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:43,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 02:01:43,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 02:01:43,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:43,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.hbase-snapshot/.tmp/foo 2023-02-15 02:01:43,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-15 02:01:43,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:43,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:43,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.hbase-snapshot/foo 2023-02-15 02:01:43,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-15 02:01:43,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.hbase-snapshot/.tmp/foo 2023-02-15 02:01:43,930 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.hbase-snapshot/.tmp/foo 2023-02-15 02:01:43,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676426503717Consolidate snapshot: foo at 1676426503837 (+120 ms)Loading Region manifests for foo at 1676426503837Writing data manifest for foo at 1676426503844 (+7 ms)Verifying snapshot: foo at 1676426503869 (+25 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676426503929 (+60 ms) 2023-02-15 02:01:43,931 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 02:01:43,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 214 msec 2023-02-15 02:01:44,020 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:44,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 02:01:44,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:44,022 INFO [Listener at localhost.localdomain/40263] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:44,026 INFO [Listener at localhost.localdomain/40263] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:44,031 INFO [Listener at localhost.localdomain/40263] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:44,071 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35767] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,185 INFO [Listener at localhost.localdomain/40263] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:44,193 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:44,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,196 INFO [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 02:01:44,196 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:44,197 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-15 02:01:44,197 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-15 02:01:44,198 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,198 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,199 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:44,199 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:44,199 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:44,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,199 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,200 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,207 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 02:01:44,207 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:44,207 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 02:01:44,208 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 02:01:44,208 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:44,211 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 02:01:44,212 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,212 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:44,212 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 02:01:44,212 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 02:01:44,212 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. started... 2023-02-15 02:01:44,212 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34431,1676426501730' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 02:01:44,212 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ea8315a228292088e8fc65ce1de78e9f 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 02:01:44,221 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,221 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,221 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:44,253 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f1/44384fd1fa0f42cca979c073b13ba057 2023-02-15 02:01:44,301 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f2/4affd5857c874a3589cd25670cc4a215 2023-02-15 02:01:44,305 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f1/44384fd1fa0f42cca979c073b13ba057 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/44384fd1fa0f42cca979c073b13ba057 2023-02-15 02:01:44,308 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/44384fd1fa0f42cca979c073b13ba057, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:44,309 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/.tmp/f2/4affd5857c874a3589cd25670cc4a215 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/4affd5857c874a3589cd25670cc4a215 2023-02-15 02:01:44,313 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/4affd5857c874a3589cd25670cc4a215, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:44,318 INFO [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ea8315a228292088e8fc65ce1de78e9f in 106ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:44,319 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ea8315a228292088e8fc65ce1de78e9f: 2023-02-15 02:01:44,319 DEBUG [rs(jenkins-hbase20.apache.org,35767,1676426501702)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,320 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 02:01:44,320 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 02:01:44,320 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,320 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 02:01:44,320 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35767,1676426501702' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 02:01:44,321 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,321 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:44,321 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,321 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:44,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:44,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35767,1676426501702' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-15 02:01:44,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fc1eea1[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:44,323 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-15 02:01:44,323 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,323 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,323 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 02:01:44,323 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 02:01:44,323 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,35767,1676426501702' in zk 2023-02-15 02:01:44,324 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,324 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 02:01:44,324 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 02:01:44,324 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,34431,1676426501730' in zk 2023-02-15 02:01:44,325 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 02:01:44,325 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:44,325 DEBUG [member: 'jenkins-hbase20.apache.org,35767,1676426501702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 02:01:44,325 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,325 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 02:01:44,325 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:44,325 DEBUG [member: 'jenkins-hbase20.apache.org,34431,1676426501730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 02:01:44,325 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35767,1676426501702' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-15 02:01:44,325 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:44,325 INFO [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-15 02:01:44,325 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:44,325 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:44,325 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,325 INFO [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:44,327 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,327 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,327 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:44,327 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,327 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:44,327 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:44,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,328 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:44,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,329 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:44,329 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,331 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:44,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:44,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:44,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 02:01:44,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,332 DEBUG [(jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:44,332 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:44,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:44,333 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:44,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:44,336 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:44,336 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:44,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:44,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:44,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:44,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:44,433 DEBUG [Listener at localhost.localdomain/40263] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:44,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:44,448 INFO [Listener at localhost.localdomain/40263] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676426503707 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:44,448 DEBUG [Listener at localhost.localdomain/40263] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:37299/user/jenkins/test-data/9d494445-17a2-d6db-5bff-73f831d4ba8b/foo/36fb53f5-470f-47b2-b928-1be6cd7a6e1d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,448 INFO [Listener at localhost.localdomain/40263] snapshot.RestoreSnapshotHelper(239): region to add: ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:44,449 INFO [Listener at localhost.localdomain/40263] snapshot.RestoreSnapshotHelper(585): clone region=ea8315a228292088e8fc65ce1de78e9f as ea8315a228292088e8fc65ce1de78e9f in snapshot foo 2023-02-15 02:01:44,449 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ea8315a228292088e8fc65ce1de78e9f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37299/user/jenkins/test-data/9d494445-17a2-d6db-5bff-73f831d4ba8b/foo/36fb53f5-470f-47b2-b928-1be6cd7a6e1d 2023-02-15 02:01:44,458 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:44,458 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 80af2faa911f4e37ba65994041b9da88 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,460 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d39b3d3011ff4f66ba110b5d73d07e3e from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,462 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ea8315a228292088e8fc65ce1de78e9f, disabling compactions & flushes 2023-02-15 02:01:44,462 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,462 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,462 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. after waiting 0 ms 2023-02-15 02:01:44,462 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,462 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,462 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ea8315a228292088e8fc65ce1de78e9f: 2023-02-15 02:01:44,464 INFO [Listener at localhost.localdomain/40263] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676426503707 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:44,464 DEBUG [Listener at localhost.localdomain/40263] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:37299/user/jenkins/test-data/9d494445-17a2-d6db-5bff-73f831d4ba8b/foo/36fb53f5-470f-47b2-b928-1be6cd7a6e1d 2023-02-15 02:01:44,464 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:37299/user/jenkins/test-data/9d494445-17a2-d6db-5bff-73f831d4ba8b/foo/36fb53f5-470f-47b2-b928-1be6cd7a6e1d 2023-02-15 02:01:44,465 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:44,465 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:44,466 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-15 02:01:44,466 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(699): |----------ea8315a228292088e8fc65ce1de78e9f/ 2023-02-15 02:01:44,467 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:44,467 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:44,467 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=ea8315a228292088e8fc65ce1de78e9f-80af2faa911f4e37ba65994041b9da88 2023-02-15 02:01:44,467 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:44,468 DEBUG [Listener at localhost.localdomain/40263] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=ea8315a228292088e8fc65ce1de78e9f-d39b3d3011ff4f66ba110b5d73d07e3e hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/44384fd1fa0f42cca979c073b13ba057 hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88 hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/4affd5857c874a3589cd25670cc4a215 hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e 2023-02-15 02:01:44,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-15 02:01:44,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 02:01:44,478 INFO [Listener at localhost.localdomain/40263] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,481 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426504481"}]},"ts":"1676426504481"} 2023-02-15 02:01:44,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:44,482 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-15 02:01:44,483 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-15 02:01:44,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, UNASSIGN}] 2023-02-15 02:01:44,485 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, UNASSIGN 2023-02-15 02:01:44,487 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ea8315a228292088e8fc65ce1de78e9f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,487 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676426504487"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426504487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426504487"}]},"ts":"1676426504487"} 2023-02-15 02:01:44,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ea8315a228292088e8fc65ce1de78e9f, server=jenkins-hbase20.apache.org,35767,1676426501702}] 2023-02-15 02:01:44,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:44,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:44,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ea8315a228292088e8fc65ce1de78e9f, disabling compactions & flushes 2023-02-15 02:01:44,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. after waiting 0 ms 2023-02-15 02:01:44,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:44,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f. 2023-02-15 02:01:44,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ea8315a228292088e8fc65ce1de78e9f: 2023-02-15 02:01:44,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:44,648 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ea8315a228292088e8fc65ce1de78e9f, regionState=CLOSED 2023-02-15 02:01:44,648 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676426504648"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426504648"}]},"ts":"1676426504648"} 2023-02-15 02:01:44,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 02:01:44,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ea8315a228292088e8fc65ce1de78e9f, server=jenkins-hbase20.apache.org,35767,1676426501702 in 161 msec 2023-02-15 02:01:44,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 02:01:44,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ea8315a228292088e8fc65ce1de78e9f, UNASSIGN in 166 msec 2023-02-15 02:01:44,656 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426504656"}]},"ts":"1676426504656"} 2023-02-15 02:01:44,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-15 02:01:44,658 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-15 02:01:44,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 181 msec 2023-02-15 02:01:44,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:44,785 INFO [Listener at localhost.localdomain/40263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-15 02:01:44,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,789 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,789 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:44,792 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:44,794 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1, FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2, FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/recovered.edits] 2023-02-15 02:01:44,797 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/44384fd1fa0f42cca979c073b13ba057 to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/44384fd1fa0f42cca979c073b13ba057 2023-02-15 02:01:44,798 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88 to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f1/80af2faa911f4e37ba65994041b9da88 2023-02-15 02:01:44,800 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/4affd5857c874a3589cd25670cc4a215 to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/4affd5857c874a3589cd25670cc4a215 2023-02-15 02:01:44,801 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/f2/d39b3d3011ff4f66ba110b5d73d07e3e 2023-02-15 02:01:44,803 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/recovered.edits/12.seqid to hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f/recovered.edits/12.seqid 2023-02-15 02:01:44,804 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ea8315a228292088e8fc65ce1de78e9f 2023-02-15 02:01:44,804 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 02:01:44,806 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,809 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-15 02:01:44,818 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-15 02:01:44,819 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,819 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-15 02:01:44,819 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426504819"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:44,822 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 02:01:44,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ea8315a228292088e8fc65ce1de78e9f, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676426502986.ea8315a228292088e8fc65ce1de78e9f.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 02:01:44,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-15 02:01:44,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676426504822"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:44,824 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-15 02:01:44,826 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 02:01:44,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 40 msec 2023-02-15 02:01:44,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:44,892 INFO [Listener at localhost.localdomain/40263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-15 02:01:44,892 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:44,892 INFO [Listener at localhost.localdomain/40263] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:44,892 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11902d8d to 127.0.0.1:63048 2023-02-15 02:01:44,892 DEBUG [Listener at localhost.localdomain/40263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:44,892 DEBUG [Listener at localhost.localdomain/40263] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:44,892 DEBUG [Listener at localhost.localdomain/40263] util.JVMClusterUtil(257): Found active master hash=1104807282, stopped=false 2023-02-15 02:01:44,892 INFO [Listener at localhost.localdomain/40263] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:44,893 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:44,893 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:44,894 INFO [Listener at localhost.localdomain/40263] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:44,894 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:44,895 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:44,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:44,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:44,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:44,897 DEBUG [Listener at localhost.localdomain/40263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x543d0a50 to 127.0.0.1:63048 2023-02-15 02:01:44,897 DEBUG [Listener at localhost.localdomain/40263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:44,897 INFO [Listener at localhost.localdomain/40263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35767,1676426501702' ***** 2023-02-15 02:01:44,897 INFO [Listener at localhost.localdomain/40263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:44,897 INFO [Listener at localhost.localdomain/40263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34431,1676426501730' ***** 2023-02-15 02:01:44,897 INFO [Listener at localhost.localdomain/40263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:44,898 INFO [RS:1;jenkins-hbase20:34431] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:44,898 INFO [RS:0;jenkins-hbase20:35767] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:44,898 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:44,898 INFO [RS:0;jenkins-hbase20:35767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:44,898 INFO [RS:0;jenkins-hbase20:35767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:44,898 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(3304): Received CLOSE for b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:44,898 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:44,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b145418d3bc0988cd7f48cdebdcb7d5f, disabling compactions & flushes 2023-02-15 02:01:44,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:44,898 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:44,898 INFO [RS:1;jenkins-hbase20:34431] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:44,898 INFO [RS:1;jenkins-hbase20:34431] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:44,898 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:44,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:44,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. after waiting 0 ms 2023-02-15 02:01:44,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:44,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing b145418d3bc0988cd7f48cdebdcb7d5f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:44,899 DEBUG [RS:1;jenkins-hbase20:34431] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33989c57 to 127.0.0.1:63048 2023-02-15 02:01:44,899 DEBUG [RS:1;jenkins-hbase20:34431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:44,899 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34431,1676426501730; all regions closed. 2023-02-15 02:01:44,898 DEBUG [RS:0;jenkins-hbase20:35767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1592265d to 127.0.0.1:63048 2023-02-15 02:01:44,900 DEBUG [RS:0;jenkins-hbase20:35767] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:44,901 INFO [RS:0;jenkins-hbase20:35767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:44,901 INFO [RS:0;jenkins-hbase20:35767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:44,901 INFO [RS:0;jenkins-hbase20:35767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:44,901 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:44,901 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 02:01:44,901 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1479): Online Regions={b145418d3bc0988cd7f48cdebdcb7d5f=hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f., 1588230740=hbase:meta,,1.1588230740} 2023-02-15 02:01:44,901 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1505): Waiting on 1588230740, b145418d3bc0988cd7f48cdebdcb7d5f 2023-02-15 02:01:44,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:44,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:44,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:44,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:44,901 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:44,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.47 KB heapSize=7.87 KB 2023-02-15 02:01:44,910 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/WALs/jenkins-hbase20.apache.org,34431,1676426501730/jenkins-hbase20.apache.org%2C34431%2C1676426501730.1676426503103 not finished, retry = 0 2023-02-15 02:01:44,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/.tmp/info/46504a402f564b2894e1a02d0ed54aba 2023-02-15 02:01:44,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/.tmp/info/46504a402f564b2894e1a02d0ed54aba as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/info/46504a402f564b2894e1a02d0ed54aba 2023-02-15 02:01:44,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/info/46504a402f564b2894e1a02d0ed54aba, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:44,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b145418d3bc0988cd7f48cdebdcb7d5f in 39ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:44,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/namespace/b145418d3bc0988cd7f48cdebdcb7d5f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:44,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:44,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b145418d3bc0988cd7f48cdebdcb7d5f: 2023-02-15 02:01:44,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426502445.b145418d3bc0988cd7f48cdebdcb7d5f. 2023-02-15 02:01:44,978 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:44,990 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:45,013 DEBUG [RS:1;jenkins-hbase20:34431] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/oldWALs 2023-02-15 02:01:45,013 INFO [RS:1;jenkins-hbase20:34431] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34431%2C1676426501730:(num 1676426503103) 2023-02-15 02:01:45,013 DEBUG [RS:1;jenkins-hbase20:34431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:45,013 INFO [RS:1;jenkins-hbase20:34431] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:45,014 INFO [RS:1;jenkins-hbase20:34431] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:45,014 INFO [RS:1;jenkins-hbase20:34431] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:45,014 INFO [RS:1;jenkins-hbase20:34431] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:45,014 INFO [RS:1;jenkins-hbase20:34431] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:45,014 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:45,016 INFO [RS:1;jenkins-hbase20:34431] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34431 2023-02-15 02:01:45,087 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 02:01:45,087 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 02:01:45,106 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 02:01:45,107 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:45,107 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:45,107 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:45,107 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34431,1676426501730 2023-02-15 02:01:45,107 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ad312cd rejected from java.util.concurrent.ThreadPoolExecutor@1eec854f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,111 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:45,112 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@683870a2 rejected from java.util.concurrent.ThreadPoolExecutor@1eec854f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,177 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:45,202 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34431,1676426501730] 2023-02-15 02:01:45,202 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34431,1676426501730; numProcessing=1 2023-02-15 02:01:45,203 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34431,1676426501730 already deleted, retry=false 2023-02-15 02:01:45,203 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34431,1676426501730 expired; onlineServers=1 2023-02-15 02:01:45,303 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:45,303 INFO [RS:1;jenkins-hbase20:34431] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34431,1676426501730; zookeeper connection closed. 2023-02-15 02:01:45,303 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@104374ef rejected from java.util.concurrent.ThreadPoolExecutor@1eec854f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,303 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:34431-0x10163de1fad0002, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:45,303 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10d73d03 rejected from java.util.concurrent.ThreadPoolExecutor@1eec854f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,304 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7581137] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7581137 2023-02-15 02:01:45,307 DEBUG [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 02:01:45,348 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/.tmp/info/d84166220206493886207b561db43d77 2023-02-15 02:01:45,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d84166220206493886207b561db43d77 2023-02-15 02:01:45,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/.tmp/rep_barrier/59fcbbdb70064e8fbda3299a131583b7 2023-02-15 02:01:45,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59fcbbdb70064e8fbda3299a131583b7 2023-02-15 02:01:45,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/.tmp/table/17a370cc0f714faaa1db5032929aaa06 2023-02-15 02:01:45,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17a370cc0f714faaa1db5032929aaa06 2023-02-15 02:01:45,421 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/.tmp/info/d84166220206493886207b561db43d77 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/info/d84166220206493886207b561db43d77 2023-02-15 02:01:45,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d84166220206493886207b561db43d77 2023-02-15 02:01:45,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/info/d84166220206493886207b561db43d77, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 02:01:45,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/.tmp/rep_barrier/59fcbbdb70064e8fbda3299a131583b7 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/rep_barrier/59fcbbdb70064e8fbda3299a131583b7 2023-02-15 02:01:45,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59fcbbdb70064e8fbda3299a131583b7 2023-02-15 02:01:45,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/rep_barrier/59fcbbdb70064e8fbda3299a131583b7, entries=1, sequenceid=21, filesize=5.1 K 2023-02-15 02:01:45,430 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/.tmp/table/17a370cc0f714faaa1db5032929aaa06 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/table/17a370cc0f714faaa1db5032929aaa06 2023-02-15 02:01:45,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17a370cc0f714faaa1db5032929aaa06 2023-02-15 02:01:45,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/table/17a370cc0f714faaa1db5032929aaa06, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 02:01:45,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.47 KB/4577, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 533ms, sequenceid=21, compaction requested=false 2023-02-15 02:01:45,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 02:01:45,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:45,463 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:45,463 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:45,463 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:45,507 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35767,1676426501702; all regions closed. 2023-02-15 02:01:45,515 DEBUG [RS:0;jenkins-hbase20:35767] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/oldWALs 2023-02-15 02:01:45,515 INFO [RS:0;jenkins-hbase20:35767] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35767%2C1676426501702.meta:.meta(num 1676426502378) 2023-02-15 02:01:45,522 DEBUG [RS:0;jenkins-hbase20:35767] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/oldWALs 2023-02-15 02:01:45,522 INFO [RS:0;jenkins-hbase20:35767] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35767%2C1676426501702:(num 1676426502809) 2023-02-15 02:01:45,522 DEBUG [RS:0;jenkins-hbase20:35767] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:45,522 INFO [RS:0;jenkins-hbase20:35767] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:45,522 INFO [RS:0;jenkins-hbase20:35767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:45,522 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:45,523 INFO [RS:0;jenkins-hbase20:35767] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35767 2023-02-15 02:01:45,524 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35767,1676426501702 2023-02-15 02:01:45,524 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:45,524 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@425b1f5a rejected from java.util.concurrent.ThreadPoolExecutor@466483c9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,525 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35767,1676426501702] 2023-02-15 02:01:45,525 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35767,1676426501702; numProcessing=2 2023-02-15 02:01:45,526 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35767,1676426501702 already deleted, retry=false 2023-02-15 02:01:45,526 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,35767,1676426501702 expired; onlineServers=0 2023-02-15 02:01:45,526 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,40989,1676426501653' ***** 2023-02-15 02:01:45,526 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:45,527 DEBUG [M:0;jenkins-hbase20:40989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e59991, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:45,527 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,40989,1676426501653 2023-02-15 02:01:45,527 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,40989,1676426501653; all regions closed. 2023-02-15 02:01:45,527 DEBUG [M:0;jenkins-hbase20:40989] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:45,527 DEBUG [M:0;jenkins-hbase20:40989] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:45,527 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:45,527 DEBUG [M:0;jenkins-hbase20:40989] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:45,527 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426501938] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426501938,5,FailOnTimeoutGroup] 2023-02-15 02:01:45,527 INFO [M:0;jenkins-hbase20:40989] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:45,527 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426501937] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426501937,5,FailOnTimeoutGroup] 2023-02-15 02:01:45,528 INFO [M:0;jenkins-hbase20:40989] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:45,529 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:45,529 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:45,529 INFO [M:0;jenkins-hbase20:40989] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:45,529 DEBUG [M:0;jenkins-hbase20:40989] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:45,529 INFO [M:0;jenkins-hbase20:40989] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:45,530 ERROR [M:0;jenkins-hbase20:40989] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 02:01:45,531 INFO [M:0;jenkins-hbase20:40989] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:45,531 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:45,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:45,531 DEBUG [M:0;jenkins-hbase20:40989] zookeeper.ZKUtil(398): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 02:01:45,531 WARN [M:0;jenkins-hbase20:40989] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 02:01:45,531 INFO [M:0;jenkins-hbase20:40989] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:45,532 INFO [M:0;jenkins-hbase20:40989] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:45,532 DEBUG [M:0;jenkins-hbase20:40989] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:45,532 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:45,532 DEBUG [M:0;jenkins-hbase20:40989] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:45,532 DEBUG [M:0;jenkins-hbase20:40989] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:45,532 DEBUG [M:0;jenkins-hbase20:40989] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:45,532 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.65 KB 2023-02-15 02:01:45,549 INFO [M:0;jenkins-hbase20:40989] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e8a1d96541134f489323d7e9430b9ad0 2023-02-15 02:01:45,553 DEBUG [M:0;jenkins-hbase20:40989] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e8a1d96541134f489323d7e9430b9ad0 as hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e8a1d96541134f489323d7e9430b9ad0 2023-02-15 02:01:45,556 INFO [M:0;jenkins-hbase20:40989] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37299/user/jenkins/test-data/37ba0e4b-ba7f-9bf2-f949-f63105723ec5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e8a1d96541134f489323d7e9430b9ad0, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 02:01:45,557 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58043, heapSize ~67.63 KB/69256, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false 2023-02-15 02:01:45,570 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:45,570 DEBUG [M:0;jenkins-hbase20:40989] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:45,573 INFO [M:0;jenkins-hbase20:40989] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:45,573 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:45,574 INFO [M:0;jenkins-hbase20:40989] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40989 2023-02-15 02:01:45,582 DEBUG [M:0;jenkins-hbase20:40989] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,40989,1676426501653 already deleted, retry=false 2023-02-15 02:01:45,625 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:45,625 INFO [RS:0;jenkins-hbase20:35767] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35767,1676426501702; zookeeper connection closed. 2023-02-15 02:01:45,625 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2814fc94 rejected from java.util.concurrent.ThreadPoolExecutor@466483c9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,625 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d50b293] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d50b293 2023-02-15 02:01:45,625 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:35767-0x10163de1fad0001, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:45,626 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50372054 rejected from java.util.concurrent.ThreadPoolExecutor@466483c9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,626 INFO [Listener at localhost.localdomain/40263] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:45,725 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:45,725 INFO [M:0;jenkins-hbase20:40989] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,40989,1676426501653; zookeeper connection closed. 2023-02-15 02:01:45,726 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71a2d653 rejected from java.util.concurrent.ThreadPoolExecutor@759d4cbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,726 DEBUG [Listener at localhost.localdomain/40263-EventThread] zookeeper.ZKWatcher(600): master:40989-0x10163de1fad0000, quorum=127.0.0.1:63048, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:45,726 ERROR [Listener at localhost.localdomain/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6692ceeb rejected from java.util.concurrent.ThreadPoolExecutor@759d4cbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 50] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:45,726 WARN [Listener at localhost.localdomain/40263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:45,734 INFO [Listener at localhost.localdomain/40263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:45,837 WARN [BP-1140242406-148.251.75.209-1676426501151 heartbeating to localhost.localdomain/127.0.0.1:37299] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:45,837 WARN [BP-1140242406-148.251.75.209-1676426501151 heartbeating to localhost.localdomain/127.0.0.1:37299] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1140242406-148.251.75.209-1676426501151 (Datanode Uuid 3a771c4a-2ca6-4df0-911f-563e4bec251a) service to localhost.localdomain/127.0.0.1:37299 2023-02-15 02:01:45,838 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/dfs/data/data3/current/BP-1140242406-148.251.75.209-1676426501151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:45,838 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/dfs/data/data4/current/BP-1140242406-148.251.75.209-1676426501151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:45,840 WARN [Listener at localhost.localdomain/40263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:45,845 INFO [Listener at localhost.localdomain/40263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:45,950 WARN [BP-1140242406-148.251.75.209-1676426501151 heartbeating to localhost.localdomain/127.0.0.1:37299] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:45,950 WARN [BP-1140242406-148.251.75.209-1676426501151 heartbeating to localhost.localdomain/127.0.0.1:37299] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1140242406-148.251.75.209-1676426501151 (Datanode Uuid e651bb80-3711-4153-b189-8df0e282c3f0) service to localhost.localdomain/127.0.0.1:37299 2023-02-15 02:01:45,951 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/dfs/data/data1/current/BP-1140242406-148.251.75.209-1676426501151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:45,951 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/cluster_0013952a-f1b6-1396-71e2-b12022ebe372/dfs/data/data2/current/BP-1140242406-148.251.75.209-1676426501151] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:45,961 INFO [Listener at localhost.localdomain/40263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:46,077 INFO [Listener at localhost.localdomain/40263] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:46,108 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:46,120 INFO [Listener at localhost.localdomain/40263] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 254) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost.localdomain:37299 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,40989,1676426501653)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:37299 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37299 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37299 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/40263 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37299 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:37299 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost.localdomain:37299 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=568 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 256), ProcessCount=166 (was 162) - ProcessCount LEAK? -, AvailableMemoryMB=4646 (was 5565) 2023-02-15 02:01:46,139 INFO [Listener at localhost.localdomain/40263] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=568, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=166, AvailableMemoryMB=4640 2023-02-15 02:01:46,155 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/hadoop.log.dir so I do NOT create it in target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29 2023-02-15 02:01:46,155 WARN [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 02:01:46,155 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/hadoop.tmp.dir so I do NOT create it in target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29 2023-02-15 02:01:46,155 WARN [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86f0bec-a5b6-bc6b-93d4-08de617e059c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 02:01:46,155 DEBUG [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29 2023-02-15 02:01:46,156 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 02:01:46,156 INFO [Listener at localhost.localdomain/40263] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a, deleteOnExit=true 2023-02-15 02:01:46,156 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 02:01:46,156 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/test.cache.data in system properties and HBase conf 2023-02-15 02:01:46,156 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 02:01:46,156 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/hadoop.log.dir in system properties and HBase conf 2023-02-15 02:01:46,157 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 02:01:46,157 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 02:01:46,157 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 02:01:46,157 DEBUG [Listener at localhost.localdomain/40263] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 02:01:46,157 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:46,157 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:46,158 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 02:01:46,159 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/nfs.dump.dir in system properties and HBase conf 2023-02-15 02:01:46,159 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/java.io.tmpdir in system properties and HBase conf 2023-02-15 02:01:46,159 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 02:01:46,159 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 02:01:46,159 INFO [Listener at localhost.localdomain/40263] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 02:01:46,163 WARN [Listener at localhost.localdomain/40263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:46,163 WARN [Listener at localhost.localdomain/40263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:46,257 WARN [Listener at localhost.localdomain/40263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:46,259 INFO [Listener at localhost.localdomain/40263] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:46,268 INFO [Listener at localhost.localdomain/40263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/java.io.tmpdir/Jetty_localhost_localdomain_41361_hdfs____.j83h5h/webapp 2023-02-15 02:01:46,360 INFO [Listener at localhost.localdomain/40263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:41361 2023-02-15 02:01:46,364 WARN [Listener at localhost.localdomain/40263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 02:01:46,364 WARN [Listener at localhost.localdomain/40263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 02:01:46,411 WARN [Listener at localhost.localdomain/36597] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:46,432 WARN [Listener at localhost.localdomain/36597] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:46,434 WARN [Listener at localhost.localdomain/36597] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:46,436 INFO [Listener at localhost.localdomain/36597] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:46,446 INFO [Listener at localhost.localdomain/36597] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/java.io.tmpdir/Jetty_localhost_46151_datanode____bs9xrm/webapp 2023-02-15 02:01:46,558 INFO [Listener at localhost.localdomain/36597] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46151 2023-02-15 02:01:46,575 WARN [Listener at localhost.localdomain/44637] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:46,592 WARN [Listener at localhost.localdomain/44637] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 02:01:46,594 WARN [Listener at localhost.localdomain/44637] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 02:01:46,595 INFO [Listener at localhost.localdomain/44637] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 02:01:46,606 INFO [Listener at localhost.localdomain/44637] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/java.io.tmpdir/Jetty_localhost_44283_datanode____ite4k4/webapp 2023-02-15 02:01:46,647 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x58a71723117d9fda: Processing first storage report for DS-9c77ca51-dca1-4fd9-b216-0506c89014bd from datanode 5a9fc64a-9e5e-4b2f-8ab7-6e1b16c01eb9 2023-02-15 02:01:46,647 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x58a71723117d9fda: from storage DS-9c77ca51-dca1-4fd9-b216-0506c89014bd node DatanodeRegistration(127.0.0.1:42839, datanodeUuid=5a9fc64a-9e5e-4b2f-8ab7-6e1b16c01eb9, infoPort=46825, infoSecurePort=0, ipcPort=44637, storageInfo=lv=-57;cid=testClusterID;nsid=1871178337;c=1676426506228), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 02:01:46,647 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x58a71723117d9fda: Processing first storage report for DS-395e549e-3e11-49cf-a195-7a66887485f6 from datanode 5a9fc64a-9e5e-4b2f-8ab7-6e1b16c01eb9 2023-02-15 02:01:46,647 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x58a71723117d9fda: from storage DS-395e549e-3e11-49cf-a195-7a66887485f6 node DatanodeRegistration(127.0.0.1:42839, datanodeUuid=5a9fc64a-9e5e-4b2f-8ab7-6e1b16c01eb9, infoPort=46825, infoSecurePort=0, ipcPort=44637, storageInfo=lv=-57;cid=testClusterID;nsid=1871178337;c=1676426506228), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:46,693 INFO [Listener at localhost.localdomain/44637] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44283 2023-02-15 02:01:46,707 WARN [Listener at localhost.localdomain/34445] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 02:01:46,779 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb46ae0a26995cb89: Processing first storage report for DS-7518ce73-ed08-46ed-9267-9ad12f522e7b from datanode 35ad570a-754b-4a56-bbe9-07d41e91949e 2023-02-15 02:01:46,779 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb46ae0a26995cb89: from storage DS-7518ce73-ed08-46ed-9267-9ad12f522e7b node DatanodeRegistration(127.0.0.1:40071, datanodeUuid=35ad570a-754b-4a56-bbe9-07d41e91949e, infoPort=34735, infoSecurePort=0, ipcPort=34445, storageInfo=lv=-57;cid=testClusterID;nsid=1871178337;c=1676426506228), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 02:01:46,779 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb46ae0a26995cb89: Processing first storage report for DS-0eef1188-45a3-4041-9367-da6b58004c6a from datanode 35ad570a-754b-4a56-bbe9-07d41e91949e 2023-02-15 02:01:46,780 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb46ae0a26995cb89: from storage DS-0eef1188-45a3-4041-9367-da6b58004c6a node DatanodeRegistration(127.0.0.1:40071, datanodeUuid=35ad570a-754b-4a56-bbe9-07d41e91949e, infoPort=34735, infoSecurePort=0, ipcPort=34445, storageInfo=lv=-57;cid=testClusterID;nsid=1871178337;c=1676426506228), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 02:01:46,818 DEBUG [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29 2023-02-15 02:01:46,820 INFO [Listener at localhost.localdomain/34445] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/zookeeper_0, clientPort=63720, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 02:01:46,821 INFO [Listener at localhost.localdomain/34445] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63720 2023-02-15 02:01:46,821 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,822 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,835 INFO [Listener at localhost.localdomain/34445] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd with version=8 2023-02-15 02:01:46,835 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,836 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,837 INFO [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/hbase-staging 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:46,838 INFO [Listener at localhost.localdomain/34445] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:46,839 INFO [Listener at localhost.localdomain/34445] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40151 2023-02-15 02:01:46,839 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,839 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,840 INFO [Listener at localhost.localdomain/34445] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40151 connecting to ZooKeeper ensemble=127.0.0.1:63720 2023-02-15 02:01:46,844 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:401510x0, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:46,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40151-0x10163de33f30000 connected 2023-02-15 02:01:46,855 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:46,856 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:46,856 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:46,857 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40151 2023-02-15 02:01:46,857 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40151 2023-02-15 02:01:46,857 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40151 2023-02-15 02:01:46,858 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40151 2023-02-15 02:01:46,858 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40151 2023-02-15 02:01:46,858 INFO [Listener at localhost.localdomain/34445] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd, hbase.cluster.distributed=false 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:46,874 INFO [Listener at localhost.localdomain/34445] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:46,875 INFO [Listener at localhost.localdomain/34445] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42583 2023-02-15 02:01:46,875 INFO [Listener at localhost.localdomain/34445] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:46,876 DEBUG [Listener at localhost.localdomain/34445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:46,876 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,876 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,877 INFO [Listener at localhost.localdomain/34445] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42583 connecting to ZooKeeper ensemble=127.0.0.1:63720 2023-02-15 02:01:46,878 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:425830x0, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:46,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42583-0x10163de33f30001 connected 2023-02-15 02:01:46,880 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:46,881 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:46,882 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:46,882 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42583 2023-02-15 02:01:46,882 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42583 2023-02-15 02:01:46,883 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42583 2023-02-15 02:01:46,883 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42583 2023-02-15 02:01:46,883 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42583 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 02:01:46,893 INFO [Listener at localhost.localdomain/34445] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 02:01:46,894 INFO [Listener at localhost.localdomain/34445] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41947 2023-02-15 02:01:46,894 INFO [Listener at localhost.localdomain/34445] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 02:01:46,895 DEBUG [Listener at localhost.localdomain/34445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:46,895 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,896 INFO [Listener at localhost.localdomain/34445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,896 INFO [Listener at localhost.localdomain/34445] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41947 connecting to ZooKeeper ensemble=127.0.0.1:63720 2023-02-15 02:01:46,908 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:419470x0, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 02:01:46,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41947-0x10163de33f30002 connected 2023-02-15 02:01:46,909 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:46,910 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:46,910 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 02:01:46,911 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41947 2023-02-15 02:01:46,911 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41947 2023-02-15 02:01:46,911 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41947 2023-02-15 02:01:46,912 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41947 2023-02-15 02:01:46,912 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41947 2023-02-15 02:01:46,914 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:46,920 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:46,921 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:46,924 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:46,924 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:46,924 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:46,924 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:46,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:46,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 02:01:46,931 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,40151,1676426506838 from backup master directory 2023-02-15 02:01:46,937 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:46,937 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 02:01:46,937 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:46,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:46,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/hbase.id with ID: 3f7729b7-a77e-42ac-9820-6c6b919619fc 2023-02-15 02:01:46,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 02:01:46,955 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:46,962 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x43c27bea to 127.0.0.1:63720 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:46,967 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@704f8e1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:46,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:46,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 02:01:46,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:46,969 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store-tmp 2023-02-15 02:01:46,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:46,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:46,978 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:46,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:46,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:46,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:46,978 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:46,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:46,979 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/WALs/jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:46,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40151%2C1676426506838, suffix=, logDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/WALs/jenkins-hbase20.apache.org,40151,1676426506838, archiveDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/oldWALs, maxLogs=10 2023-02-15 02:01:46,995 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK] 2023-02-15 02:01:46,995 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK] 2023-02-15 02:01:46,997 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/WALs/jenkins-hbase20.apache.org,40151,1676426506838/jenkins-hbase20.apache.org%2C40151%2C1676426506838.1676426506982 2023-02-15 02:01:46,997 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK], DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK]] 2023-02-15 02:01:46,997 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:46,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:46,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:46,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:47,001 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:47,002 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 02:01:47,003 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 02:01:47,003 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:47,004 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:47,004 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:47,006 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 02:01:47,007 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:47,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58982891, jitterRate=-0.12108643352985382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:47,008 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:47,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 02:01:47,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 02:01:47,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 02:01:47,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 02:01:47,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 02:01:47,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 02:01:47,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 02:01:47,010 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 02:01:47,011 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 02:01:47,019 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 02:01:47,019 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 02:01:47,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 02:01:47,020 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 02:01:47,020 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 02:01:47,622 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:47,622 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 02:01:47,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 02:01:47,625 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 02:01:47,761 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:47,761 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:47,761 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:47,761 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:47,761 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,40151,1676426506838, sessionid=0x10163de33f30000, setting cluster-up flag (Was=false) 2023-02-15 02:01:47,798 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:47,799 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 02:01:47,800 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:47,802 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:47,803 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 02:01:47,804 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:47,804 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.hbase-snapshot/.tmp 2023-02-15 02:01:47,805 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:47,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676426537808 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 02:01:47,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,808 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:47,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 02:01:47,809 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 02:01:47,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 02:01:47,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 02:01:47,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 02:01:47,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 02:01:47,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426507810,5,FailOnTimeoutGroup] 2023-02-15 02:01:47,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426507810,5,FailOnTimeoutGroup] 2023-02-15 02:01:47,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,810 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:47,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 02:01:47,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,817 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(952): ClusterId : 3f7729b7-a77e-42ac-9820-6c6b919619fc 2023-02-15 02:01:47,817 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:47,817 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(952): ClusterId : 3f7729b7-a77e-42ac-9820-6c6b919619fc 2023-02-15 02:01:47,817 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 02:01:47,818 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:47,818 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:47,818 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 02:01:47,818 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 02:01:47,819 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:47,819 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 02:01:47,823 DEBUG [RS:1;jenkins-hbase20:41947] zookeeper.ReadOnlyZKClient(139): Connect 0x781f98a6 to 127.0.0.1:63720 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:47,823 DEBUG [RS:0;jenkins-hbase20:42583] zookeeper.ReadOnlyZKClient(139): Connect 0x37b212bb to 127.0.0.1:63720 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:47,829 DEBUG [RS:1;jenkins-hbase20:41947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76d869d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:47,829 DEBUG [RS:0;jenkins-hbase20:42583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3975ea3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:47,829 DEBUG [RS:1;jenkins-hbase20:41947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72e7f3d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:47,829 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:47,829 DEBUG [RS:0;jenkins-hbase20:42583] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d4a79cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:47,829 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:47,829 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd 2023-02-15 02:01:47,839 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:41947 2023-02-15 02:01:47,839 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:42583 2023-02-15 02:01:47,839 INFO [RS:1;jenkins-hbase20:41947] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:47,839 INFO [RS:1;jenkins-hbase20:41947] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:47,839 INFO [RS:0;jenkins-hbase20:42583] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 02:01:47,839 INFO [RS:0;jenkins-hbase20:42583] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 02:01:47,839 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:47,839 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 02:01:47,840 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40151,1676426506838 with isa=jenkins-hbase20.apache.org/148.251.75.209:41947, startcode=1676426506892 2023-02-15 02:01:47,840 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40151,1676426506838 with isa=jenkins-hbase20.apache.org/148.251.75.209:42583, startcode=1676426506873 2023-02-15 02:01:47,840 DEBUG [RS:1;jenkins-hbase20:41947] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:47,840 DEBUG [RS:0;jenkins-hbase20:42583] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 02:01:47,841 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33695, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:47,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,859 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd 2023-02-15 02:01:47,859 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37871, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 02:01:47,859 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36597 2023-02-15 02:01:47,859 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:47,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,860 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd 2023-02-15 02:01:47,860 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36597 2023-02-15 02:01:47,860 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 02:01:47,860 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:47,862 DEBUG [RS:0;jenkins-hbase20:42583] zookeeper.ZKUtil(162): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,862 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41947,1676426506892] 2023-02-15 02:01:47,863 WARN [RS:0;jenkins-hbase20:42583] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:47,863 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42583,1676426506873] 2023-02-15 02:01:47,863 INFO [RS:0;jenkins-hbase20:42583] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:47,863 DEBUG [RS:1;jenkins-hbase20:41947] zookeeper.ZKUtil(162): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,863 WARN [RS:1;jenkins-hbase20:41947] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 02:01:47,863 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,863 INFO [RS:1;jenkins-hbase20:41947] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:47,863 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,871 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:47,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:47,881 DEBUG [RS:1;jenkins-hbase20:41947] zookeeper.ZKUtil(162): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,881 DEBUG [RS:0;jenkins-hbase20:42583] zookeeper.ZKUtil(162): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,882 DEBUG [RS:1;jenkins-hbase20:41947] zookeeper.ZKUtil(162): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,882 DEBUG [RS:0;jenkins-hbase20:42583] zookeeper.ZKUtil(162): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/info 2023-02-15 02:01:47,882 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:47,882 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:47,882 DEBUG [RS:1;jenkins-hbase20:41947] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 02:01:47,883 INFO [RS:0;jenkins-hbase20:42583] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:47,883 INFO [RS:1;jenkins-hbase20:41947] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 02:01:47,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:47,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:47,884 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:47,884 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:47,885 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:47,885 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:47,886 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/table 2023-02-15 02:01:47,887 INFO [RS:1;jenkins-hbase20:41947] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:47,887 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:47,887 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:47,891 INFO [RS:0;jenkins-hbase20:42583] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 02:01:47,891 INFO [RS:1;jenkins-hbase20:41947] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:47,891 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,892 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:47,907 INFO [RS:0;jenkins-hbase20:42583] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 02:01:47,907 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,911 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 02:01:47,916 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,916 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740 2023-02-15 02:01:47,916 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740 2023-02-15 02:01:47,916 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,916 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:0;jenkins-hbase20:42583] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,916 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-15 02:01:47,917 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,917 DEBUG [RS:1;jenkins-hbase20:41947] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-15 02:01:47,918 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:47,919 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:47,939 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,939 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,939 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,939 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,939 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,939 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,958 INFO [RS:0;jenkins-hbase20:42583] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:47,958 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42583,1676426506873-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,959 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:47,961 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62468845, jitterRate=-0.06914167106151581}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:47,961 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:47,961 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:47,961 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:47,961 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:47,961 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:47,961 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:47,966 INFO [RS:1;jenkins-hbase20:41947] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 02:01:47,967 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41947,1676426506892-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:47,975 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:47,975 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:47,976 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 02:01:47,976 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 02:01:47,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 02:01:47,979 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 02:01:47,981 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 02:01:47,988 INFO [RS:0;jenkins-hbase20:42583] regionserver.Replication(203): jenkins-hbase20.apache.org,42583,1676426506873 started 2023-02-15 02:01:47,988 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42583,1676426506873, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42583, sessionid=0x10163de33f30001 2023-02-15 02:01:47,989 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:47,989 DEBUG [RS:0;jenkins-hbase20:42583] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,989 DEBUG [RS:0;jenkins-hbase20:42583] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42583,1676426506873' 2023-02-15 02:01:47,989 DEBUG [RS:0;jenkins-hbase20:42583] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:47,989 DEBUG [RS:0;jenkins-hbase20:42583] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42583,1676426506873' 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:47,990 DEBUG [RS:0;jenkins-hbase20:42583] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:47,991 INFO [RS:0;jenkins-hbase20:42583] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:47,991 INFO [RS:0;jenkins-hbase20:42583] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:47,991 INFO [RS:1;jenkins-hbase20:41947] regionserver.Replication(203): jenkins-hbase20.apache.org,41947,1676426506892 started 2023-02-15 02:01:47,991 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41947,1676426506892, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41947, sessionid=0x10163de33f30002 2023-02-15 02:01:47,992 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 02:01:47,992 DEBUG [RS:1;jenkins-hbase20:41947] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,992 DEBUG [RS:1;jenkins-hbase20:41947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41947,1676426506892' 2023-02-15 02:01:47,992 DEBUG [RS:1;jenkins-hbase20:41947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:47,995 DEBUG [RS:1;jenkins-hbase20:41947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:47,995 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 02:01:47,995 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 02:01:47,995 DEBUG [RS:1;jenkins-hbase20:41947] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:47,995 DEBUG [RS:1;jenkins-hbase20:41947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41947,1676426506892' 2023-02-15 02:01:47,995 DEBUG [RS:1;jenkins-hbase20:41947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:47,996 DEBUG [RS:1;jenkins-hbase20:41947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:47,996 DEBUG [RS:1;jenkins-hbase20:41947] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 02:01:47,996 INFO [RS:1;jenkins-hbase20:41947] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 02:01:47,996 INFO [RS:1;jenkins-hbase20:41947] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 02:01:48,132 DEBUG [jenkins-hbase20:40151] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 02:01:48,132 DEBUG [jenkins-hbase20:40151] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:48,134 DEBUG [jenkins-hbase20:40151] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:48,134 DEBUG [jenkins-hbase20:40151] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:48,134 DEBUG [jenkins-hbase20:40151] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:48,134 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42583,1676426506873, state=OPENING 2023-02-15 02:01:48,135 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 02:01:48,136 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:48,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42583,1676426506873}] 2023-02-15 02:01:48,136 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:48,290 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:48,290 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 02:01:48,292 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60682, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 02:01:48,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 02:01:48,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 02:01:48,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42583%2C1676426506873.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,42583,1676426506873, archiveDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/oldWALs, maxLogs=32 2023-02-15 02:01:48,310 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK] 2023-02-15 02:01:48,310 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK] 2023-02-15 02:01:48,312 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,42583,1676426506873/jenkins-hbase20.apache.org%2C42583%2C1676426506873.meta.1676426508298.meta 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK], DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK]] 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 02:01:48,312 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 02:01:48,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 02:01:48,313 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 02:01:48,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/info 2023-02-15 02:01:48,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/info 2023-02-15 02:01:48,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 02:01:48,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:48,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 02:01:48,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:48,316 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/rep_barrier 2023-02-15 02:01:48,316 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 02:01:48,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:48,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 02:01:48,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/table 2023-02-15 02:01:48,318 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/table 2023-02-15 02:01:48,318 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 02:01:48,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:48,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740 2023-02-15 02:01:48,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740 2023-02-15 02:01:48,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 02:01:48,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 02:01:48,322 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69064240, jitterRate=0.029137372970581055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 02:01:48,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 02:01:48,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676426508290 2023-02-15 02:01:48,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 02:01:48,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 02:01:48,328 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42583,1676426506873, state=OPEN 2023-02-15 02:01:48,329 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 02:01:48,329 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 02:01:48,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 02:01:48,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42583,1676426506873 in 193 msec 2023-02-15 02:01:48,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 02:01:48,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-15 02:01:48,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 526 msec 2023-02-15 02:01:48,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676426508332, completionTime=-1 2023-02-15 02:01:48,332 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 02:01:48,332 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 02:01:48,337 DEBUG [hconnection-0x2db2dc01-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:48,339 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60696, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:48,339 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 02:01:48,339 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676426568339 2023-02-15 02:01:48,340 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676426628340 2023-02-15 02:01:48,340 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40151,1676426506838-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40151,1676426506838-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40151,1676426506838-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:40151, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 02:01:48,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:48,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 02:01:48,349 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 02:01:48,350 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:48,351 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:48,352 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/hbase/namespace/27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,353 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/hbase/namespace/27984d573212fb37c50d5f0909533564 empty. 2023-02-15 02:01:48,353 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/hbase/namespace/27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,353 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 02:01:48,367 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:48,369 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 27984d573212fb37c50d5f0909533564, NAME => 'hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp 2023-02-15 02:01:48,379 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:48,379 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 27984d573212fb37c50d5f0909533564, disabling compactions & flushes 2023-02-15 02:01:48,379 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,379 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,379 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. after waiting 0 ms 2023-02-15 02:01:48,379 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,379 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,379 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 27984d573212fb37c50d5f0909533564: 2023-02-15 02:01:48,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:48,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426508381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426508381"}]},"ts":"1676426508381"} 2023-02-15 02:01:48,382 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:48,383 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:48,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426508383"}]},"ts":"1676426508383"} 2023-02-15 02:01:48,384 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 02:01:48,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:48,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:48,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:48,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:48,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=27984d573212fb37c50d5f0909533564, ASSIGN}] 2023-02-15 02:01:48,388 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=27984d573212fb37c50d5f0909533564, ASSIGN 2023-02-15 02:01:48,389 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=27984d573212fb37c50d5f0909533564, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42583,1676426506873; forceNewPlan=false, retain=false 2023-02-15 02:01:48,539 INFO [jenkins-hbase20:40151] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:48,539 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=27984d573212fb37c50d5f0909533564, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:48,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426508539"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426508539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426508539"}]},"ts":"1676426508539"} 2023-02-15 02:01:48,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 27984d573212fb37c50d5f0909533564, server=jenkins-hbase20.apache.org,42583,1676426506873}] 2023-02-15 02:01:48,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42583%2C1676426506873, suffix=, logDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,42583,1676426506873, archiveDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/oldWALs, maxLogs=32 2023-02-15 02:01:48,708 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK] 2023-02-15 02:01:48,708 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK] 2023-02-15 02:01:48,709 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,42583,1676426506873/jenkins-hbase20.apache.org%2C42583%2C1676426506873.1676426508697 2023-02-15 02:01:48,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK], DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK]] 2023-02-15 02:01:48,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 27984d573212fb37c50d5f0909533564, NAME => 'hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:48,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:48,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,711 INFO [StoreOpener-27984d573212fb37c50d5f0909533564-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,712 DEBUG [StoreOpener-27984d573212fb37c50d5f0909533564-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/info 2023-02-15 02:01:48,712 DEBUG [StoreOpener-27984d573212fb37c50d5f0909533564-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/info 2023-02-15 02:01:48,712 INFO [StoreOpener-27984d573212fb37c50d5f0909533564-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27984d573212fb37c50d5f0909533564 columnFamilyName info 2023-02-15 02:01:48,712 INFO [StoreOpener-27984d573212fb37c50d5f0909533564-1] regionserver.HStore(310): Store=27984d573212fb37c50d5f0909533564/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:48,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:48,717 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:48,718 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 27984d573212fb37c50d5f0909533564; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65334817, jitterRate=-0.026435360312461853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 02:01:48,718 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 27984d573212fb37c50d5f0909533564: 2023-02-15 02:01:48,719 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564., pid=6, masterSystemTime=1676426508693 2023-02-15 02:01:48,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,720 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:48,720 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=27984d573212fb37c50d5f0909533564, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:48,721 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676426508720"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426508720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426508720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426508720"}]},"ts":"1676426508720"} 2023-02-15 02:01:48,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 02:01:48,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 27984d573212fb37c50d5f0909533564, server=jenkins-hbase20.apache.org,42583,1676426506873 in 181 msec 2023-02-15 02:01:48,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 02:01:48,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=27984d573212fb37c50d5f0909533564, ASSIGN in 338 msec 2023-02-15 02:01:48,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:48,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426508726"}]},"ts":"1676426508726"} 2023-02-15 02:01:48,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 02:01:48,730 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:48,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-15 02:01:48,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 02:01:48,750 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:48,750 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:48,753 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 02:01:48,762 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:48,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 02:01:48,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 02:01:48,781 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 02:01:48,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-15 02:01:48,788 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 02:01:48,789 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 02:01:48,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.852sec 2023-02-15 02:01:48,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 02:01:48,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 02:01:48,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 02:01:48,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40151,1676426506838-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 02:01:48,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40151,1676426506838-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 02:01:48,791 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 02:01:48,817 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ReadOnlyZKClient(139): Connect 0x538c2c34 to 127.0.0.1:63720 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:48,820 DEBUG [Listener at localhost.localdomain/34445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf2fe96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:48,821 DEBUG [hconnection-0x3895efca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:48,822 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:48,824 INFO [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:48,824 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 02:01:48,826 DEBUG [Listener at localhost.localdomain/34445] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 02:01:48,827 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 02:01:48,828 INFO [Listener at localhost.localdomain/34445] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 02:01:48,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-15 02:01:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 02:01:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 148.251.75.209:46826 deadline: 1676426568828, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 02:01:48,829 INFO [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 02:01:48,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 02:01:48,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 02:01:48,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 02:01:48,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 02:01:48,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 02:01:48,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:48,836 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:48,837 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 empty. 2023-02-15 02:01:48,837 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:48,837 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 02:01:48,844 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 02:01:48,846 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf28f49943ff9fbf77d30b2ccce31482, NAME => 'testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp 2023-02-15 02:01:48,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:48,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cf28f49943ff9fbf77d30b2ccce31482, disabling compactions & flushes 2023-02-15 02:01:48,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:48,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:48,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. after waiting 0 ms 2023-02-15 02:01:48,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:48,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:48,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:48,859 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 02:01:48,860 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676426508860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426508860"}]},"ts":"1676426508860"} 2023-02-15 02:01:48,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 02:01:48,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 02:01:48,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426508862"}]},"ts":"1676426508862"} 2023-02-15 02:01:48,863 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 02:01:48,865 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-15 02:01:48,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 02:01:48,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 02:01:48,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 02:01:48,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, ASSIGN}] 2023-02-15 02:01:48,868 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, ASSIGN 2023-02-15 02:01:48,868 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42583,1676426506873; forceNewPlan=false, retain=false 2023-02-15 02:01:48,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:48,998 INFO [RS:1;jenkins-hbase20:41947] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41947%2C1676426506892, suffix=, logDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,41947,1676426506892, archiveDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/oldWALs, maxLogs=32 2023-02-15 02:01:49,016 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK] 2023-02-15 02:01:49,016 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK] 2023-02-15 02:01:49,017 INFO [RS:1;jenkins-hbase20:41947] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/WALs/jenkins-hbase20.apache.org,41947,1676426506892/jenkins-hbase20.apache.org%2C41947%2C1676426506892.1676426508998 2023-02-15 02:01:49,018 DEBUG [RS:1;jenkins-hbase20:41947] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40071,DS-7518ce73-ed08-46ed-9267-9ad12f522e7b,DISK], DatanodeInfoWithStorage[127.0.0.1:42839,DS-9c77ca51-dca1-4fd9-b216-0506c89014bd,DISK]] 2023-02-15 02:01:49,018 INFO [jenkins-hbase20:40151] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 02:01:49,019 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cf28f49943ff9fbf77d30b2ccce31482, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,019 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676426509018"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426509018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426509018"}]},"ts":"1676426509018"} 2023-02-15 02:01:49,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure cf28f49943ff9fbf77d30b2ccce31482, server=jenkins-hbase20.apache.org,42583,1676426506873}] 2023-02-15 02:01:49,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:49,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:49,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf28f49943ff9fbf77d30b2ccce31482, NAME => 'testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.', STARTKEY => '', ENDKEY => ''} 2023-02-15 02:01:49,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:49,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,176 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,177 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1 2023-02-15 02:01:49,177 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1 2023-02-15 02:01:49,177 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf28f49943ff9fbf77d30b2ccce31482 columnFamilyName f1 2023-02-15 02:01:49,178 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(310): Store=cf28f49943ff9fbf77d30b2ccce31482/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:49,178 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,179 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2 2023-02-15 02:01:49,179 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2 2023-02-15 02:01:49,179 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf28f49943ff9fbf77d30b2ccce31482 columnFamilyName f2 2023-02-15 02:01:49,180 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(310): Store=cf28f49943ff9fbf77d30b2ccce31482/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:49,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:49,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:49,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 02:01:49,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened cf28f49943ff9fbf77d30b2ccce31482; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59069837, jitterRate=-0.11979083716869354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:49,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:49,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482., pid=12, masterSystemTime=1676426509171 2023-02-15 02:01:49,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:49,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:49,187 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cf28f49943ff9fbf77d30b2ccce31482, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676426509187"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676426509187"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676426509187"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676426509187"}]},"ts":"1676426509187"} 2023-02-15 02:01:49,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 02:01:49,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure cf28f49943ff9fbf77d30b2ccce31482, server=jenkins-hbase20.apache.org,42583,1676426506873 in 169 msec 2023-02-15 02:01:49,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 02:01:49,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, ASSIGN in 323 msec 2023-02-15 02:01:49,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 02:01:49,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426509192"}]},"ts":"1676426509192"} 2023-02-15 02:01:49,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 02:01:49,196 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 02:01:49,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 364 msec 2023-02-15 02:01:49,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 02:01:49,440 INFO [Listener at localhost.localdomain/34445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 02:01:49,440 DEBUG [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 02:01:49,440 INFO [Listener at localhost.localdomain/34445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:49,442 INFO [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 02:01:49,442 INFO [Listener at localhost.localdomain/34445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 02:01:49,442 INFO [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 02:01:49,442 INFO [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 02:01:49,478 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42583] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:49,554 INFO [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 02:01:49,554 INFO [Listener at localhost.localdomain/34445] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 02:01:49,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:49,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676426509555 (current time:1676426509555). 2023-02-15 02:01:49,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 02:01:49,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] zookeeper.ReadOnlyZKClient(139): Connect 0x0f50c488 to 127.0.0.1:63720 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 02:01:49,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45fc93d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 02:01:49,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 02:01:49,559 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60710, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 02:01:49,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f50c488 to 127.0.0.1:63720 2023-02-15 02:01:49,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:49,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 02:01:49,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:49,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:49,563 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:49,563 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676427109563 2023-02-15 02:01:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 02:01:49,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 02:01:49,564 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:49,564 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 02:01:49,567 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 02:01:49,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:49,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-15 02:01:49,569 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:49,570 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676427109570 2023-02-15 02:01:49,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-15 02:01:49,579 INFO [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-15 02:01:49,579 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:49,580 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-15 02:01:49,580 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 02:01:49,580 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,580 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,581 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:49,581 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:49,581 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:49,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:49,581 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,582 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 02:01:49,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 02:01:49,583 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 02:01:49,583 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:49,583 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 02:01:49,584 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 02:01:49,584 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 02:01:49,587 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 02:01:49,587 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41947,1676426506892' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 02:01:49,587 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 02:01:49,587 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 02:01:49,587 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42583,1676426506873' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 02:01:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,588 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:49,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 02:01:49,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:49,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42583,1676426506873' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-15 02:01:49,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d5d200[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:49,591 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 02:01:49,591 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,591 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,591 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,592 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 02:01:49,592 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 02:01:49,592 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,592 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:49,592 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 02:01:49,592 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,41947,1676426506892' in zk 2023-02-15 02:01:49,593 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 02:01:49,593 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:49,593 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 02:01:49,597 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 02:01:49,597 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 02:01:49,597 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:49,597 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. started... 2023-02-15 02:01:49,598 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cf28f49943ff9fbf77d30b2ccce31482 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 02:01:49,622 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f1/f3953e97a60b4813a5556f328cba5f96 2023-02-15 02:01:49,645 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f2/f1364256255f4ac299b3e6ad747442ef 2023-02-15 02:01:49,656 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f1/f3953e97a60b4813a5556f328cba5f96 as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/f3953e97a60b4813a5556f328cba5f96 2023-02-15 02:01:49,660 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/f3953e97a60b4813a5556f328cba5f96, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:49,662 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f2/f1364256255f4ac299b3e6ad747442ef as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/f1364256255f4ac299b3e6ad747442ef 2023-02-15 02:01:49,664 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:49,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:49,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 02:01:49,667 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 02:01:49,676 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/f1364256255f4ac299b3e6ad747442ef, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 02:01:49,677 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for cf28f49943ff9fbf77d30b2ccce31482 in 79ms, sequenceid=5, compaction requested=false 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/f3953e97a60b4813a5556f328cba5f96] hfiles 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/f3953e97a60b4813a5556f328cba5f96 for snapshot=testWithMapReduceSingleRegion 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/f1364256255f4ac299b3e6ad747442ef] hfiles 2023-02-15 02:01:49,677 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/f1364256255f4ac299b3e6ad747442ef for snapshot=testWithMapReduceSingleRegion 2023-02-15 02:01:49,701 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. completed. 2023-02-15 02:01:49,701 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:49,701 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 02:01:49,701 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 02:01:49,701 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,701 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 02:01:49,701 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,42583,1676426506873' in zk 2023-02-15 02:01:49,702 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 02:01:49,702 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,702 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:49,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:49,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:49,702 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 02:01:49,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:49,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:49,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 02:01:49,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 02:01:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,42583,1676426506873': 2023-02-15 02:01:49,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42583,1676426506873' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 02:01:49,705 INFO [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-15 02:01:49,706 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:49,706 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:49,706 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-15 02:01:49,706 INFO [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 02:01:49,712 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:49,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 02:01:49,713 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:49,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,713 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 02:01:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 02:01:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,714 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,714 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 02:01:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 02:01:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 02:01:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 02:01:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:49,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:49,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-15 02:01:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 02:01:49,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 02:01:49,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-15 02:01:49,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-15 02:01:49,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 02:01:49,762 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 02:01:49,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676426509564Consolidate snapshot: testWithMapReduceSingleRegion at 1676426509719 (+155 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676426509719Writing data manifest for testWithMapReduceSingleRegion at 1676426509721 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676426509732 (+11 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676426509761 (+29 ms) 2023-02-15 02:01:49,763 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 02:01:49,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 196 msec 2023-02-15 02:01:49,867 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 02:01:49,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 02:01:49,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 02:01:49,868 INFO [Listener at localhost.localdomain/34445] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 02:01:49,872 INFO [Listener at localhost.localdomain/34445] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 02:01:49,876 INFO [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 02:01:49,907 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42583] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,008 INFO [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 02:01:50,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-15 02:01:50,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 02:01:50,017 INFO [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 02:01:50,017 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:50,017 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 02:01:50,017 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 02:01:50,017 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,018 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,018 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:50,018 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:50,018 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:50,019 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,019 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 02:01:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,019 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 02:01:50,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 02:01:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 02:01:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 02:01:50,023 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 02:01:50,023 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:50,023 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 02:01:50,023 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 02:01:50,023 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41947,1676426506892' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 02:01:50,024 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,024 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,024 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:50,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 02:01:50,027 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 02:01:50,027 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 02:01:50,027 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 02:01:50,031 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 02:01:50,031 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 02:01:50,031 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,031 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. started... 2023-02-15 02:01:50,031 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf28f49943ff9fbf77d30b2ccce31482 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 02:01:50,069 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f1/2ca3cb094c01451997646cd4ac0c273b 2023-02-15 02:01:50,104 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f2/9277f39083cc4ed1bec96c1905d2b472 2023-02-15 02:01:50,109 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f1/2ca3cb094c01451997646cd4ac0c273b as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/2ca3cb094c01451997646cd4ac0c273b 2023-02-15 02:01:50,114 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/2ca3cb094c01451997646cd4ac0c273b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:50,116 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/.tmp/f2/9277f39083cc4ed1bec96c1905d2b472 as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/9277f39083cc4ed1bec96c1905d2b472 2023-02-15 02:01:50,127 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/9277f39083cc4ed1bec96c1905d2b472, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 02:01:50,127 INFO [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for cf28f49943ff9fbf77d30b2ccce31482 in 96ms, sequenceid=9, compaction requested=false 2023-02-15 02:01:50,128 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:50,128 DEBUG [rs(jenkins-hbase20.apache.org,42583,1676426506873)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,128 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 02:01:50,128 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 02:01:50,128 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,128 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 02:01:50,128 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42583,1676426506873' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 02:01:50,129 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,129 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:50,129 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,129 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 02:01:50,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:50,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:50,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42583,1676426506873' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 02:01:50,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dea49e2[Count = 0] remaining members to acquire global barrier 2023-02-15 02:01:50,132 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 02:01:50,132 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 02:01:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 02:01:50,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,42583,1676426506873' in zk 2023-02-15 02:01:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 02:01:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 02:01:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,41947,1676426506892' in zk 2023-02-15 02:01:50,133 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,134 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 02:01:50,135 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 02:01:50,135 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 02:01:50,135 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:50,135 DEBUG [member: 'jenkins-hbase20.apache.org,41947,1676426506892' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 02:01:50,135 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:50,135 DEBUG [member: 'jenkins-hbase20.apache.org,42583,1676426506873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 02:01:50,135 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,42583,1676426506873': 2023-02-15 02:01:50,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42583,1676426506873' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 02:01:50,139 INFO [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 02:01:50,139 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 02:01:50,139 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 02:01:50,139 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 02:01:50,139 INFO [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 02:01:50,141 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:50,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:50,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 02:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 02:01:50,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:50,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 02:01:50,141 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:50,142 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 02:01:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,144 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 02:01:50,145 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 02:01:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:50,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 02:01:50,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:50,148 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 02:01:50,148 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 02:01:50,148 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 02:01:50,148 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 02:01:50,147 DEBUG [(jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 02:01:50,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 02:01:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 02:01:50,147 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 02:01:50,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:50,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 02:01:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 02:01:50,149 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 02:01:50,248 DEBUG [Listener at localhost.localdomain/34445] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 02:01:50,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 02:01:50,363 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/hadoop-2015050259914423345.jar 2023-02-15 02:01:50,367 INFO [Listener at localhost.localdomain/34445] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676426509555 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:50,368 DEBUG [Listener at localhost.localdomain/34445] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad/data/default/testWithMapReduce 2023-02-15 02:01:50,369 INFO [Listener at localhost.localdomain/34445] snapshot.RestoreSnapshotHelper(239): region to add: cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:50,370 INFO [Listener at localhost.localdomain/34445] snapshot.RestoreSnapshotHelper(585): clone region=cf28f49943ff9fbf77d30b2ccce31482 as cf28f49943ff9fbf77d30b2ccce31482 in snapshot testWithMapReduceSingleRegion 2023-02-15 02:01:50,370 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf28f49943ff9fbf77d30b2ccce31482, NAME => 'testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad 2023-02-15 02:01:50,788 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:50,788 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3953e97a60b4813a5556f328cba5f96 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 02:01:50,790 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1364256255f4ac299b3e6ad747442ef from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 02:01:50,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cf28f49943ff9fbf77d30b2ccce31482, disabling compactions & flushes 2023-02-15 02:01:50,792 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. after waiting 0 ms 2023-02-15 02:01:50,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,792 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:50,792 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:50,792 INFO [Listener at localhost.localdomain/34445] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676426509555 type: FLUSH version: 2 ttl: 0 2023-02-15 02:01:50,792 DEBUG [Listener at localhost.localdomain/34445] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad 2023-02-15 02:01:50,792 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad 2023-02-15 02:01:50,793 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(699): |-data/ 2023-02-15 02:01:50,793 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(699): |----default/ 2023-02-15 02:01:50,793 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 02:01:50,793 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(699): |----------cf28f49943ff9fbf77d30b2ccce31482/ 2023-02-15 02:01:50,794 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 02:01:50,794 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 02:01:50,794 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(702): |----------------testWithMapReduce=cf28f49943ff9fbf77d30b2ccce31482-f3953e97a60b4813a5556f328cba5f96 2023-02-15 02:01:50,794 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 02:01:50,794 DEBUG [Listener at localhost.localdomain/34445] util.CommonFSUtils(702): |----------------testWithMapReduce=cf28f49943ff9fbf77d30b2ccce31482-f1364256255f4ac299b3e6ad747442ef 2023-02-15 02:01:50,795 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:50,796 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:50,796 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:50,797 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,615 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/hadoop-5485146300260266176.jar 2023-02-15 02:01:51,616 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,616 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,671 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/hadoop-8308295721296551710.jar 2023-02-15 02:01:51,671 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,671 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,672 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,672 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,672 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,672 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,673 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 02:01:51,673 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 02:01:51,673 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 02:01:51,674 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 02:01:51,674 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 02:01:51,674 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 02:01:51,674 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 02:01:51,675 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 02:01:51,675 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 02:01:51,675 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 02:01:51,676 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 02:01:51,676 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:51,676 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:51,677 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 02:01:51,677 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 02:01:51,734 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/hadoop-4804589570883913911.jar 2023-02-15 02:01:51,734 DEBUG [Listener at localhost.localdomain/34445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 02:01:51,739 WARN [Listener at localhost.localdomain/34445] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 02:01:51,744 WARN [Listener at localhost.localdomain/34445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-15 02:01:51,749 INFO [Listener at localhost.localdomain/34445] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 02:01:51,825 WARN [Listener at localhost.localdomain/34445] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/mapreduce.cluster.local.dir/1676426511792/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 02:01:51,826 WARN [Listener at localhost.localdomain/34445] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/mapreduce.cluster.local.dir/1676426511792/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 02:01:51,855 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 02:01:51,855 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 02:01:51,856 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 02:01:51,858 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:51,859 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1 2023-02-15 02:01:51,859 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf28f49943ff9fbf77d30b2ccce31482 columnFamilyName f1 2023-02-15 02:01:51,864 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/testWithMapReduce=cf28f49943ff9fbf77d30b2ccce31482-f3953e97a60b4813a5556f328cba5f96 2023-02-15 02:01:51,864 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(310): Store=cf28f49943ff9fbf77d30b2ccce31482/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:51,864 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:51,865 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2 2023-02-15 02:01:51,866 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf28f49943ff9fbf77d30b2ccce31482 columnFamilyName f2 2023-02-15 02:01:51,870 DEBUG [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36597/user/jenkins/test-data/97b21313-7adb-4c1f-e75f-68b356a3ab9c/testWithMapReduceSingleRegion/f81254ba-72a0-42ea-9230-31f9bac730ad/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/testWithMapReduce=cf28f49943ff9fbf77d30b2ccce31482-f1364256255f4ac299b3e6ad747442ef 2023-02-15 02:01:51,871 INFO [StoreOpener-cf28f49943ff9fbf77d30b2ccce31482-1] regionserver.HStore(310): Store=cf28f49943ff9fbf77d30b2ccce31482/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 02:01:51,871 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 02:01:51,871 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cf28f49943ff9fbf77d30b2ccce31482; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61461807, jitterRate=-0.08414770662784576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 02:01:51,871 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:51,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cf28f49943ff9fbf77d30b2ccce31482, disabling compactions & flushes 2023-02-15 02:01:51,984 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:51,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:51,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. after waiting 0 ms 2023-02-15 02:01:51,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:51,985 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:51,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:52,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceSingleRegion" 2023-02-15 02:01:52,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-15 02:01:52,862 INFO [Listener at localhost.localdomain/34445] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 02:01:52,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-15 02:01:52,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 02:01:52,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426512865"}]},"ts":"1676426512865"} 2023-02-15 02:01:52,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:52,866 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 02:01:52,867 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 02:01:52,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, UNASSIGN}] 2023-02-15 02:01:52,868 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, UNASSIGN 2023-02-15 02:01:52,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf28f49943ff9fbf77d30b2ccce31482, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:52,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676426512869"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676426512869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676426512869"}]},"ts":"1676426512869"} 2023-02-15 02:01:52,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure cf28f49943ff9fbf77d30b2ccce31482, server=jenkins-hbase20.apache.org,42583,1676426506873}] 2023-02-15 02:01:52,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:53,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing cf28f49943ff9fbf77d30b2ccce31482, disabling compactions & flushes 2023-02-15 02:01:53,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. after waiting 0 ms 2023-02-15 02:01:53,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:53,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 02:01:53,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482. 2023-02-15 02:01:53,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for cf28f49943ff9fbf77d30b2ccce31482: 2023-02-15 02:01:53,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:53,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf28f49943ff9fbf77d30b2ccce31482, regionState=CLOSED 2023-02-15 02:01:53,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676426513028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676426513028"}]},"ts":"1676426513028"} 2023-02-15 02:01:53,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 02:01:53,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure cf28f49943ff9fbf77d30b2ccce31482, server=jenkins-hbase20.apache.org,42583,1676426506873 in 159 msec 2023-02-15 02:01:53,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 02:01:53,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf28f49943ff9fbf77d30b2ccce31482, UNASSIGN in 163 msec 2023-02-15 02:01:53,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676426513032"}]},"ts":"1676426513032"} 2023-02-15 02:01:53,033 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 02:01:53,033 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 02:01:53,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 172 msec 2023-02-15 02:01:53,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 02:01:53,170 INFO [Listener at localhost.localdomain/34445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-15 02:01:53,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-15 02:01:53,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:53,175 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:53,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:53,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:53,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:53,182 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1, FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2, FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/recovered.edits] 2023-02-15 02:01:53,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/2ca3cb094c01451997646cd4ac0c273b to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/archive/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/2ca3cb094c01451997646cd4ac0c273b 2023-02-15 02:01:53,186 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/f3953e97a60b4813a5556f328cba5f96 to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/archive/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f1/f3953e97a60b4813a5556f328cba5f96 2023-02-15 02:01:53,188 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/9277f39083cc4ed1bec96c1905d2b472 to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/archive/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/9277f39083cc4ed1bec96c1905d2b472 2023-02-15 02:01:53,189 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/f1364256255f4ac299b3e6ad747442ef to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/archive/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/f2/f1364256255f4ac299b3e6ad747442ef 2023-02-15 02:01:53,192 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/recovered.edits/12.seqid to hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/archive/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482/recovered.edits/12.seqid 2023-02-15 02:01:53,192 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/.tmp/data/default/testWithMapReduce/cf28f49943ff9fbf77d30b2ccce31482 2023-02-15 02:01:53,192 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 02:01:53,194 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:53,196 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-15 02:01:53,198 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 02:01:53,199 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:53,199 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 02:01:53,199 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676426513199"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:53,201 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 02:01:53,201 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cf28f49943ff9fbf77d30b2ccce31482, NAME => 'testWithMapReduce,,1676426508832.cf28f49943ff9fbf77d30b2ccce31482.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 02:01:53,201 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 02:01:53,201 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676426513201"}]},"ts":"9223372036854775807"} 2023-02-15 02:01:53,203 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 02:01:53,204 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 02:01:53,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 33 msec 2023-02-15 02:01:53,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40151] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 02:01:53,279 INFO [Listener at localhost.localdomain/34445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-15 02:01:53,279 INFO [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 02:01:53,279 INFO [Listener at localhost.localdomain/34445] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 02:01:53,280 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x538c2c34 to 127.0.0.1:63720 2023-02-15 02:01:53,280 DEBUG [Listener at localhost.localdomain/34445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,280 DEBUG [Listener at localhost.localdomain/34445] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 02:01:53,280 DEBUG [Listener at localhost.localdomain/34445] util.JVMClusterUtil(257): Found active master hash=506336660, stopped=false 2023-02-15 02:01:53,280 INFO [Listener at localhost.localdomain/34445] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:53,281 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:53,281 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:53,281 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 02:01:53,281 INFO [Listener at localhost.localdomain/34445] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 02:01:53,281 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:53,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:53,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:53,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 02:01:53,283 DEBUG [Listener at localhost.localdomain/34445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43c27bea to 127.0.0.1:63720 2023-02-15 02:01:53,283 DEBUG [Listener at localhost.localdomain/34445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,284 INFO [Listener at localhost.localdomain/34445] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42583,1676426506873' ***** 2023-02-15 02:01:53,284 INFO [Listener at localhost.localdomain/34445] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:53,284 INFO [Listener at localhost.localdomain/34445] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41947,1676426506892' ***** 2023-02-15 02:01:53,284 INFO [Listener at localhost.localdomain/34445] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 02:01:53,284 INFO [RS:0;jenkins-hbase20:42583] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:53,284 INFO [RS:0;jenkins-hbase20:42583] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:53,284 INFO [RS:1;jenkins-hbase20:41947] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 02:01:53,284 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:53,284 INFO [RS:1;jenkins-hbase20:41947] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 02:01:53,284 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 02:01:53,284 INFO [RS:0;jenkins-hbase20:42583] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:53,285 INFO [RS:1;jenkins-hbase20:41947] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 02:01:53,286 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(3304): Received CLOSE for 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:53,286 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:53,286 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:53,286 DEBUG [RS:1;jenkins-hbase20:41947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x781f98a6 to 127.0.0.1:63720 2023-02-15 02:01:53,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 27984d573212fb37c50d5f0909533564, disabling compactions & flushes 2023-02-15 02:01:53,286 DEBUG [RS:0;jenkins-hbase20:42583] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37b212bb to 127.0.0.1:63720 2023-02-15 02:01:53,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:53,286 DEBUG [RS:1;jenkins-hbase20:41947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:53,286 DEBUG [RS:0;jenkins-hbase20:42583] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. after waiting 0 ms 2023-02-15 02:01:53,286 INFO [RS:0;jenkins-hbase20:42583] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:53,286 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41947,1676426506892; all regions closed. 2023-02-15 02:01:53,286 INFO [RS:0;jenkins-hbase20:42583] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:53,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:53,286 INFO [RS:0;jenkins-hbase20:42583] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:53,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 27984d573212fb37c50d5f0909533564 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 02:01:53,286 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 02:01:53,287 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 02:01:53,287 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1479): Online Regions={27984d573212fb37c50d5f0909533564=hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564., 1588230740=hbase:meta,,1.1588230740} 2023-02-15 02:01:53,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 02:01:53,287 DEBUG [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1505): Waiting on 1588230740, 27984d573212fb37c50d5f0909533564 2023-02-15 02:01:53,287 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 02:01:53,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 02:01:53,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 02:01:53,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 02:01:53,287 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.71 KB heapSize=7.12 KB 2023-02-15 02:01:53,290 DEBUG [RS:1;jenkins-hbase20:41947] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/oldWALs 2023-02-15 02:01:53,290 INFO [RS:1;jenkins-hbase20:41947] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41947%2C1676426506892:(num 1676426508998) 2023-02-15 02:01:53,290 DEBUG [RS:1;jenkins-hbase20:41947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,290 INFO [RS:1;jenkins-hbase20:41947] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:53,290 INFO [RS:1;jenkins-hbase20:41947] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:53,291 INFO [RS:1;jenkins-hbase20:41947] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 02:01:53,291 INFO [RS:1;jenkins-hbase20:41947] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 02:01:53,291 INFO [RS:1;jenkins-hbase20:41947] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 02:01:53,291 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:53,292 INFO [RS:1;jenkins-hbase20:41947] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41947 2023-02-15 02:01:53,292 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:53,292 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:53,292 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41947,1676426506892 2023-02-15 02:01:53,293 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8ec381e rejected from java.util.concurrent.ThreadPoolExecutor@cd3addb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,293 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:53,293 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1197ab2a rejected from java.util.concurrent.ThreadPoolExecutor@cd3addb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,293 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:53,293 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41947,1676426506892] 2023-02-15 02:01:53,293 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41947,1676426506892; numProcessing=1 2023-02-15 02:01:53,294 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41947,1676426506892 already deleted, retry=false 2023-02-15 02:01:53,294 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41947,1676426506892 expired; onlineServers=1 2023-02-15 02:01:53,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/.tmp/info/8773b612432e4384aaf7b4ecaa1da29a 2023-02-15 02:01:53,296 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/.tmp/info/88ef158309b54c759370969a85f945f0 2023-02-15 02:01:53,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88ef158309b54c759370969a85f945f0 2023-02-15 02:01:53,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/.tmp/info/8773b612432e4384aaf7b4ecaa1da29a as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/info/8773b612432e4384aaf7b4ecaa1da29a 2023-02-15 02:01:53,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/info/8773b612432e4384aaf7b4ecaa1da29a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 02:01:53,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 27984d573212fb37c50d5f0909533564 in 18ms, sequenceid=6, compaction requested=false 2023-02-15 02:01:53,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/.tmp/rep_barrier/a86db521e38549dca01ef00f02f9fd07 2023-02-15 02:01:53,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/namespace/27984d573212fb37c50d5f0909533564/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 02:01:53,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:53,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 27984d573212fb37c50d5f0909533564: 2023-02-15 02:01:53,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676426508347.27984d573212fb37c50d5f0909533564. 2023-02-15 02:01:53,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a86db521e38549dca01ef00f02f9fd07 2023-02-15 02:01:53,317 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/.tmp/table/5b720288e7eb450ca386f78442e56e70 2023-02-15 02:01:53,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b720288e7eb450ca386f78442e56e70 2023-02-15 02:01:53,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/.tmp/info/88ef158309b54c759370969a85f945f0 as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/info/88ef158309b54c759370969a85f945f0 2023-02-15 02:01:53,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88ef158309b54c759370969a85f945f0 2023-02-15 02:01:53,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/info/88ef158309b54c759370969a85f945f0, entries=12, sequenceid=21, filesize=6.2 K 2023-02-15 02:01:53,326 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/.tmp/rep_barrier/a86db521e38549dca01ef00f02f9fd07 as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/rep_barrier/a86db521e38549dca01ef00f02f9fd07 2023-02-15 02:01:53,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a86db521e38549dca01ef00f02f9fd07 2023-02-15 02:01:53,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/rep_barrier/a86db521e38549dca01ef00f02f9fd07, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 02:01:53,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/.tmp/table/5b720288e7eb450ca386f78442e56e70 as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/table/5b720288e7eb450ca386f78442e56e70 2023-02-15 02:01:53,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b720288e7eb450ca386f78442e56e70 2023-02-15 02:01:53,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/table/5b720288e7eb450ca386f78442e56e70, entries=4, sequenceid=21, filesize=5.0 K 2023-02-15 02:01:53,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.71 KB/3794, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-15 02:01:53,339 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 02:01:53,340 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 02:01:53,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:53,341 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 02:01:53,341 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 02:01:53,344 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:53,345 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:53,481 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:53,481 INFO [RS:1;jenkins-hbase20:41947] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41947,1676426506892; zookeeper connection closed. 2023-02-15 02:01:53,481 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@69fe9a6a rejected from java.util.concurrent.ThreadPoolExecutor@cd3addb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,481 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@453a5930] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@453a5930 2023-02-15 02:01:53,481 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:41947-0x10163de33f30002, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:53,481 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51cfd84 rejected from java.util.concurrent.ThreadPoolExecutor@cd3addb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,487 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42583,1676426506873; all regions closed. 2023-02-15 02:01:53,491 DEBUG [RS:0;jenkins-hbase20:42583] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/oldWALs 2023-02-15 02:01:53,491 INFO [RS:0;jenkins-hbase20:42583] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42583%2C1676426506873.meta:.meta(num 1676426508298) 2023-02-15 02:01:53,495 DEBUG [RS:0;jenkins-hbase20:42583] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/oldWALs 2023-02-15 02:01:53,495 INFO [RS:0;jenkins-hbase20:42583] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42583%2C1676426506873:(num 1676426508697) 2023-02-15 02:01:53,495 DEBUG [RS:0;jenkins-hbase20:42583] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,495 INFO [RS:0;jenkins-hbase20:42583] regionserver.LeaseManager(133): Closed leases 2023-02-15 02:01:53,495 INFO [RS:0;jenkins-hbase20:42583] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 02:01:53,499 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:53,499 INFO [RS:0;jenkins-hbase20:42583] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42583 2023-02-15 02:01:53,500 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42583,1676426506873 2023-02-15 02:01:53,501 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 02:01:53,501 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42583,1676426506873] 2023-02-15 02:01:53,501 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42583,1676426506873; numProcessing=2 2023-02-15 02:01:53,502 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42583,1676426506873 already deleted, retry=false 2023-02-15 02:01:53,502 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42583,1676426506873 expired; onlineServers=0 2023-02-15 02:01:53,502 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,40151,1676426506838' ***** 2023-02-15 02:01:53,502 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 02:01:53,504 DEBUG [M:0;jenkins-hbase20:40151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a118289, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-15 02:01:53,504 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,40151,1676426506838 2023-02-15 02:01:53,504 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,40151,1676426506838; all regions closed. 2023-02-15 02:01:53,504 DEBUG [M:0;jenkins-hbase20:40151] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 02:01:53,504 DEBUG [M:0;jenkins-hbase20:40151] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 02:01:53,504 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 02:01:53,504 DEBUG [M:0;jenkins-hbase20:40151] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 02:01:53,504 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426507810] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676426507810,5,FailOnTimeoutGroup] 2023-02-15 02:01:53,504 INFO [M:0;jenkins-hbase20:40151] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 02:01:53,505 INFO [M:0;jenkins-hbase20:40151] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 02:01:53,505 INFO [M:0;jenkins-hbase20:40151] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-15 02:01:53,506 DEBUG [M:0;jenkins-hbase20:40151] master.HMaster(1512): Stopping service threads 2023-02-15 02:01:53,506 INFO [M:0;jenkins-hbase20:40151] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 02:01:53,506 ERROR [M:0;jenkins-hbase20:40151] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 02:01:53,506 INFO [M:0;jenkins-hbase20:40151] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 02:01:53,506 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 02:01:53,506 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426507810] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676426507810,5,FailOnTimeoutGroup] 2023-02-15 02:01:53,508 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 02:01:53,508 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 02:01:53,508 DEBUG [M:0;jenkins-hbase20:40151] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-15 02:01:53,508 DEBUG [M:0;jenkins-hbase20:40151] master.ActiveMasterManager(335): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-15 02:01:53,509 INFO [M:0;jenkins-hbase20:40151] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 02:01:53,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 02:01:53,510 INFO [M:0;jenkins-hbase20:40151] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 02:01:53,510 DEBUG [M:0;jenkins-hbase20:40151] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 02:01:53,510 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:53,510 DEBUG [M:0;jenkins-hbase20:40151] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:53,510 DEBUG [M:0;jenkins-hbase20:40151] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 02:01:53,510 DEBUG [M:0;jenkins-hbase20:40151] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:53,510 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.72 KB heapSize=65.68 KB 2023-02-15 02:01:53,545 INFO [M:0;jenkins-hbase20:40151] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.72 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/636101d8e0a34cedbe960ec36c175371 2023-02-15 02:01:53,550 DEBUG [M:0;jenkins-hbase20:40151] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/636101d8e0a34cedbe960ec36c175371 as hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/636101d8e0a34cedbe960ec36c175371 2023-02-15 02:01:53,555 INFO [M:0;jenkins-hbase20:40151] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36597/user/jenkins/test-data/d338f2c1-d844-d432-7e0c-54b4a17a26bd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/636101d8e0a34cedbe960ec36c175371, entries=17, sequenceid=132, filesize=8.6 K 2023-02-15 02:01:53,556 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegion(2947): Finished flush of dataSize ~54.72 KB/56033, heapSize ~65.66 KB/67240, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 46ms, sequenceid=132, compaction requested=false 2023-02-15 02:01:53,560 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 02:01:53,560 DEBUG [M:0;jenkins-hbase20:40151] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 02:01:53,581 INFO [M:0;jenkins-hbase20:40151] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 02:01:53,581 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 02:01:53,581 INFO [M:0;jenkins-hbase20:40151] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40151 2023-02-15 02:01:53,582 DEBUG [M:0;jenkins-hbase20:40151] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,40151,1676426506838 already deleted, retry=false 2023-02-15 02:01:53,882 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:53,882 INFO [M:0;jenkins-hbase20:40151] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,40151,1676426506838; zookeeper connection closed. 2023-02-15 02:01:53,882 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@600dd44 rejected from java.util.concurrent.ThreadPoolExecutor@23f595c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,883 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): master:40151-0x10163de33f30000, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:53,883 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76dadbe6 rejected from java.util.concurrent.ThreadPoolExecutor@23f595c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,982 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:53,982 INFO [RS:0;jenkins-hbase20:42583] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42583,1676426506873; zookeeper connection closed. 2023-02-15 02:01:53,982 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3623fa9b rejected from java.util.concurrent.ThreadPoolExecutor@321c7887[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,982 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2152c344] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2152c344 2023-02-15 02:01:53,983 DEBUG [Listener at localhost.localdomain/34445-EventThread] zookeeper.ZKWatcher(600): regionserver:42583-0x10163de33f30001, quorum=127.0.0.1:63720, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 02:01:53,983 ERROR [Listener at localhost.localdomain/34445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ffd2e1f rejected from java.util.concurrent.ThreadPoolExecutor@321c7887[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 02:01:53,983 INFO [Listener at localhost.localdomain/34445] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 02:01:53,983 WARN [Listener at localhost.localdomain/34445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:53,990 INFO [Listener at localhost.localdomain/34445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:53,994 WARN [BP-538504304-148.251.75.209-1676426506228 heartbeating to localhost.localdomain/127.0.0.1:36597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:53,994 WARN [BP-538504304-148.251.75.209-1676426506228 heartbeating to localhost.localdomain/127.0.0.1:36597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-538504304-148.251.75.209-1676426506228 (Datanode Uuid 35ad570a-754b-4a56-bbe9-07d41e91949e) service to localhost.localdomain/127.0.0.1:36597 2023-02-15 02:01:53,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/dfs/data/data3/current/BP-538504304-148.251.75.209-1676426506228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:53,995 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/dfs/data/data4/current/BP-538504304-148.251.75.209-1676426506228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:53,997 WARN [Listener at localhost.localdomain/34445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 02:01:54,001 INFO [Listener at localhost.localdomain/34445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 02:01:54,002 WARN [BP-538504304-148.251.75.209-1676426506228 heartbeating to localhost.localdomain/127.0.0.1:36597] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 02:01:54,002 WARN [BP-538504304-148.251.75.209-1676426506228 heartbeating to localhost.localdomain/127.0.0.1:36597] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-538504304-148.251.75.209-1676426506228 (Datanode Uuid 5a9fc64a-9e5e-4b2f-8ab7-6e1b16c01eb9) service to localhost.localdomain/127.0.0.1:36597 2023-02-15 02:01:54,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/dfs/data/data1/current/BP-538504304-148.251.75.209-1676426506228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:54,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b65c50e4-ca0a-af4a-eb4d-6a76f497bb29/cluster_a02395c7-84b9-e605-af0e-986224c9ff8a/dfs/data/data2/current/BP-538504304-148.251.75.209-1676426506228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 02:01:54,020 INFO [Listener at localhost.localdomain/34445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-15 02:01:54,136 INFO [Listener at localhost.localdomain/34445] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 02:01:54,171 INFO [Listener at localhost.localdomain/34445] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 02:01:54,186 INFO [Listener at localhost.localdomain/34445] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 274) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36597 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36597 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost.localdomain:36597 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36597 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost.localdomain:36597 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:36597 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/34445 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1661136773) connection to localhost.localdomain/127.0.0.1:36597 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,40151,1676426506838)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=596 (was 568) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=4050 (was 4640)